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ABSTRACT , 

intensive i^tnd'y was conducted of \areavide planning 
for the inpleaentation of Title ir A, B, and C (foriterly Title I) of 
the Ooapre hens ive Eaployaent and Treitiing Act (CETA) , ^as perforaed by 
-priae sponsors- to aeet the needs of* th^ir coaaunities. The central, 
objectives of the research were \(1V «fco describe the planning syste as 
that have eaerged , |2) to relate "the^ features of planning ,systeas to 
contextual factors, &nd (3) to ,exi^l6r.e' the links between these 
planning systeas and prograa perforaance. Inteasive field work was 
done in twelve priae'^s^pnsorships which were selected because thay 
were -reputed to take planning seriously* Results were coapared on 
soae gaestions with national averages and with cbsesvations in thirty 
bother priae sponsorships in which intensive field work was done for 
previous studies. Three sajor aodels of planning were observed in the 
field work studies, as well as a group of exeaplary apft^o aches to 
critical eleaents of planning and aanageadnt. The acdt general' 
finding was that careful, planning by priie sponsorship staff does 
have the potential for helping iaprove prograa perforaance. Howe.ver, 
planning was found to be only one of a nuaber of aspects of priae 
sponsorship jianageaent tha^ needs to be hancfled' well in order to 
achieve prograaaatic goals. Fortunately, these eleaents of danageaent 
are highly aanipulable at 4he local level, and ron-ianipulative 
eleaents of local context such as econ6aic conditions do not create 
severe restraints on what can fce achieved, (Observations and specific 
recbaaendations for iaproving priae sponsor activities are included 
for review and iapleaentation,! (BM) 
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Pol/icy, Evaluation and Research; Emplpyhient' and Training 
Administration, U.S. Department ,of Labor, was authorized 
first under the Manpower Development and Training Act 
(MDTA) o^ 1962, ari^ then under the Comprehensive Employ-* 
ment and Training" Act (CETA) of 1973, tb conduct research, 
experimentation.^^ and demonstration to solve social* and 
economic problems relative to the employment and training 
of unemployed and underemployed workers. Research >als6 
includes ^patiipnal longitudinal surveys of age cohorts of* 
the popuSlt/ion at critical transition stages in working** 
life which exaiiiin^ the labor market experience of these 
cohorts. Studies are conducted on labor market 
structures And operations, obstacles to employm.ent, 
mobility, how individuals do job searches, and various - 
jproblems that pertain particularly to disadvantaged / 
persons.' Experimental 6r demonstration projects may 
test a 'new technique of intervention, a different \ " 
institutional arrangement for delivery, or innovative 
ways to combine resources* ' ^ - 



Analyses of the results o£ thewnost significant of these 
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issued as'' monographs in a continuing series. Information 
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the previous 3 years is contained in ^n annual catalog of 
activities, Research and Development Projects . .This 
publication and. those in the monograph series may be 
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FOREWORD 



•phis monograph focuses, on the findings and resul^ of 
an intensive study of areawide planning for the imple- 
mentation of Title II A, B, and C. (formerly Title I) of 
the Comprehtensive Employment and Training Act (CETA) , 
as performed by prime sponsors to meet the needs of 
their communities. - 

The most general finding of the report is that careful 
planning does have the potential for helping to improve 
program performance, but the "report points out very 
clearly that many other aspects of prime sponsorship 
management need to be handled well in order to achieve 
programmatic goals. In SecJ:ion IV, the report develops 
three models of planning that were observed in the 
field work studies, as well as a groijp of "exemplary 
approaches tc^ critical elements of planning and 
'njanagement . " Also in Section IV, a number of 
- productive approaches to seven specific planning and 
management elements "are described because of their 
favorable progranmiatic impact and, their potential 
utility in additional prime sponsorships. 

Observations and specific recommendations for 

improving prime sponsor activities are included 

for review and .implementation. * 



HOWARD ROSgN 
Director 

Office of Research 
and Development 




PREFATORY NOTE 
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This Is the last report In a series that focuses on planning £01: Title I 
of the Comprehensive Employment and Training Act of 1973 (Title II ABC of CETA 
as reauthorized in 1978) at the prlm^ sponsorship leve\|.. The central • 
objectives of the research have been to 1) describe Title I planning systems 
that have emerged; 2) relate the features of. planning systems to contextual 
factors; and 3) explore the links between Title I planning systems and program 
performance. , , 

This project has been supported by a grant from the Office of Research and 
Development of the Employment and Training Administration of the U.S. Department 
of Labor (No. 21-39-75-10) and by resources of the Mershon Center of Ohio State 
University. Additional support of various kinds has 'come from the Department 
of Political Science at Ohio State University, the Instruction, and Research 
Computer Center at Ohio State, the Department oJ^Govemment at Smith College 
(the* home institution of Professor Donald BaimierXa project associate)^ and. the 
Eagleton Institute. of Politics at Rutgers Universxty (the home institution of 
Professor Carl Van Horn, a project associate). 

The Director, Associate Director, and Project Associates did field irork 
in 12 prime sponsorships throughout the United States that were cho^en^ to be 
• Illustrative of areas in which Title I planning is taken seriously and to be 
representative of different" kinds of areas ixL terns of regional location, size 
of CETA, program, type of prime sponsorship, and labor market conditions. The 
field work w^ done from^March through August. 1978. Detailed reports on six of 
the sites are Included in a progress report dated June 30, 1978; similar reports 
on^the other six sitei^are included in a progress report dated September 30, 1978. 

The authorship . of this report is genuinely colleglal. Primary credit for 
the analysis in Section II belongs to Michael O'Loughlin, Marcla S.lotnlck, ^ 
iJilliam Strangfeld, and Richard Wright. Primary credit for |lje analysis in 
Sectfon III belongs to Grace Franklin and John Wichita. Franklin and Strangfeld 
are primarily responsible for the coordination between t-he two sections. 
^ Primary credit for the analysis In' Section IV belongs to Donald Baumer knd 
Carl Van Horn. The Director, Randall Ripley, 
the contents of the entire report. 



takes final responsd^bility for 



We are grateful to a large number of Indiv^lduals In the prime sponaorshlps^ 
we visited and also tj? a large number of ETA employees for their splendid coopera- 
tion* Many participated in long interviews. Others provided other kinds of 
essential data* Without such cooperation this research would have been • 
impossible. We are also grateful to Professor Aage Clausen of Ohio State for 
his advlde on the specific use of multiple regression techniques in Section III. 
Finally, we are very appreciative of the continuing support and work of 
Richard McAllister, our project off leer in the Office of Researcji^ and Development 
and, in our opinion, the model of what a good project officer should be. 
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SUMMARY 



The report focuses on planning for Title I (now Title II A, B^and C) 
of CETA at the prime sponsorship levels Intensive field work was done in 12 
prime sponsorships selected, in. part, because they were reputed to take planing 
seriously « Results are compared on some questions with national averages 
and with observations in 30 other prime sponsorships in which Intensive field 
work was done for previous studies. / , 

The mbst general finding is that careful planning by prime sponsorship 
staff does. Indeed, have the potential for helping improve program per for- 
m^ance. At. the same time, it is quit6 clear that planning is: pnly one of a 
number of general aspect? of prime sponsorship management<];iiat needs to be 
handled well in order to enhance the chances of achieving programmatic goals. 
Fortunately,, these ele mfent s of management are highly manipulable at the local 
level. Also for tunatelyT^^Jp^nianlpulab le el^ents of local context such as- 
economic conditions do not^^eate severe restraints on what can be achieved. * 
In addition, there is solfSevidence that prime sponsorships c^ target 
their resources on the moat disadvantaged part of the eligible population as 
measured by gross demographic characteristics without diminishing their 
potential for good program performance. * 

MODELS OF PLANNING 

Planning is tteated as one potentially Important structured intervention 
between contextual factors in a prime sponsorship and the results of programs. 
There are both more "technical" and'^ore "political" aspects of planning.' 
Both aspects are important and they Interact with each other in influencing 
program results. 

Three mpdels of planning were developed on* the basis of worH in 12 prime 
s)>onsoi:ships . A foiirth model (no consistent attention to planning) la also 
implicit. The three empirically developed models in which planning is taken 
seriously (even though there are severe problems in one cAse) can be stmmiarized 
briefly: 

« 

1. A crisis management model characterized by: ^ 

a. Unstable relations among actors | 

b. Unmanaged conflict 

c. Lack of routine ^ ' . 

d. Malfunctioning feedback system. 

2. An operations management model characterized by: 
^a. Stable relations among, actors 
'b. Well;;;;;r^aged conf H flW^ ^ 

c. Many routine procedures 

d. Feedback mechanism in place and utilized. 

xi 
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3. A f utute oriented model characterized by: 

• I 

a. The four characteristics of the operations management model 

b. Deliberate 'attention to long-range decisions. 

Both Operations Management and Future Oriented models are superior to No 
Consistent Planning, and to Crisis Management models. But there Is good' 
empirical evidence* that under different condltl^ons either Operations Management 
or Future Oriented planning will be relatively the most productive* There Is 
not' one "correct" way. to plan In all situations* 

THE EFFECTS OF CONTEXT ON PLANNING SYSTEMS 

General contextual factors (^nature of local economy , nature of local 
populatlon7 program slze^ and organizational nature) are not determinative of 
what kind of planning systems en^rge In Individual prime sponsorships. Locali- 
ties can design the kdSid Qf planning system they "choose for programmatic reasons 
and are not forced Into a specific planning mode by these external factors. 

<• 

The general management context In a prime sponsorship la> however, related 
to the kind of planning system that seons most likely to emerge. Thlp Is 
prob&bly because certain styles of planning fit beat with certain styles of 
m^anagement; assoclatlonal patterns were evident when future-oriented and 
operations management sites were compared (only one! site has a crisis management 
system and we dld-^not, of course, attempt to generalize from It). 

In prime sponsorships with future-orl^ted planning systems^ the associated 
management characteristics Included a pattern of staf f-niomlnated declslon*maklng 
(with only limited Influence sharing with other actors) , a stable staff of high 
quality, stronger than average support for staff from political officials, 
thorough monitoring, and the active Involvement of the prlyate business sector. 

In prime sponsorships with operations manag^ent planning systems, there 
was more likely to be less staff domination of decision-making (usua-Xly involving 
significant sharing of Influence with service delivejfers) , acre turnover in key 
staff, low Involvement of business, and less well-developed monitoring systems. 

EXPLAINING JROGBAM PERFORMANCE 

In discussing program performance we used imiltlple measures. Some were 
observational and judgmental, based on qualitative data and Impressions. We 
also used five quantitative measures, although we noted the shortcomings both 
of the data and of the measures themselves: 

f 1.^ Overall placement rate (the number of participants entering employ- « 
ment divided by the nutober enrolled) . 

* 2. ' Placement efficiency (the ^umber of participants Indirectly placed 
divided by the number enrolled). 

Nonposltlve termination rate (the nimiber of nonpositlve terminations 
* divided by the nttmber of all' terminations) * 

4. Cost per enrolled (total accrued expenditures divided by the nimiber 
of ^rollees) . 
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5. Cost per placeaaent * (total accrikd eacpenA^res divided by the 
* • . .nintibet of persons placed)'. . - , > 

• « * »»'^ * 

Managaaeat characterlstlbs and planning both have Stronger Influence pn 
perfoirmance tiian any contextual Variables. We found no aaplrlcal support fot 
thet conventional wi^bdom that augges^s ' that . economic ;^9ndltlops and. demographic 
characteristics o^. particiwts dis^terml/de or at le^st highly constrain • 

performance. • - •/ 

. * ' \- . .' . ' ' ' ■ . ' ■ 

The factors, fnost strongly associated wlOi good jperf ormance were quality ot 
staff', the nature anji exteA^t of business Hnvolv^nent,' and the quality of ^ 
monitoring? ■ jOther'fafetors were also' associated, but xaqre* moderately so. 

-EX^LARY APPROACHES TO OStXtlCAt ELEMENTS 6F PLANNING AN D MANAGEMENT • . 

Because a variety of^mattagenient ^ planning factors were found to affett 
program performance We spelled ottt In some derail specif Ic Instances bf 
approaches to som^ -key element's of planning and m^agement We had observed to 
be working wellv We found a number of productive' approaches to seven specific 
planning and management element^s we thought should be described because of • 
their favofable programmatic- impact and their potential utility In additional 
.prime sponi^orahlps. The elements on^ which we focused were: 

*C 1. Manpower planning councils ^ ' 

"2;- Monitoring knd evaluation 

. ' 3." Universe of need and target group Identification 

4. Intake and assessment strategies • . 

5. Labor market analysis * • ' ^ 

■ 6. S3^stMi design (service delivery selection, delivery systems, 
* performance contracting) ' 
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I. INTRODUCTION ' 



The Con^ehenslve Employment, and Training Act of 1973 (CETA) represents 
a compromise form of special revenfte-aharlng or block igrant enacted following 

5 years of struggle between Congress and the Administration. (For exc&llent 
background on that struggle and on the various manpower programs preceding 
CETA see Advisory Ccomlsalon on Intergovernmental Relations, 1977; Davidson, * 
1972; Levltan and Tfggart, 197A; and Levltan and Zlckler, 1974.) As a. form 
of revenue-sharing. It fembpdles a substantial restructuring of most Federal . 
manpower programs, mandating decentralization and decategorlzatlon. 
Responsibility for the transition to and operation of decentralized and 
decategbriied programs is lodged firmly with aocaOg^ficials (and, to a lesser 
extent, with State officials) by the statute. 

* • • » ^ • 

T^e statute and regulations we long and complicated. Table 1 suooarizes 
the major provisions of the 1973. act as amended in* 1974 and 1977. (The 1978 
amendments are, not Included since oul^ research dealt with the program as it 
existed under^ the provisions contained In Table 1.) 

A number of assessments of CETA operations have appeared, some focused on 
specific aspects and some quite broad In character (for several broad aaseasmefnts 
see Mlrengoff and Rlndler, 1978; Snedeker and Snedeker, 1978; and Van Horn, 1979). 
However, despite the presumed centrality of local planning in making CETA perform 
better than the pfce^CETA categorical programs, little systematic attention has 
been given to planning'. This report seeks to fill that gap. 

A. CONCEPTUAL FRAMEWORK 
J^-^' ^ • , 

The Ctimprehenslve Employment and Training Act embodies the belief that local 
prime sponsors know best how and when to respond to what specific local conditions 
In order to achieve' the general goals of the program.. Nationally, there has been 
great variation among prime sponsorships in terms of types of conditions faced* 
the types of programmatic responses generated, and the results of, the responses. 

■ ' ' ■ \, ' 

In an earlier study (Ripley and associates, 1978) we explored ? number of 
management decision areas at the local Ifevel to ascertain how they were affected 
by local conditions and, critically, how they In turn affected local .program 
performance. Our central research question in that study was: under what 
conditions do what management decision choices seem most likely to enhance 
desired program performance? 

In the present study we focus on planning as a special aspect of management. 
We are interested in describing the types of plannliig systems that have emerged, 
in relating the features of those systems to contexWl factors, and in exploring 
the links between planning systems and program performance. 

. Despite considerable literature, buttressed by rhetoric from both national 
and local sources, that asserts that • planning is central to good performance 
in employment and training programs there la little empirical work that assesses 
the nature of planning that bccurs and the Impact of that planning on programs. 
This paucity of empirical research on planrt^.ng and its consequences is especially 
ironic in the case of CETA since one of the explicit goals of CETA is "comprehensive 
programs" and one of its Implicit goals is "compriehenslve planning. The Act 
and the Department of Labor encourage comprehensiveness in botlv programs and 



1 

U 



« 



■id 



Table 1?^ SOMMARY OF THE COMPREHENSIVE 
EMPIOYMBNT AND TRAINING ACT (CETA) OF 1973 

■ ^ 

. The Comprehensive Baployment axsA Training Act of 1973 (PL 93-203) , 
as amended- by the Emergeilcy Jobs and Unemployment Assistance Act of 197A 
.(PL 93-567), by the Emergency Jobs Programs Extension Act of 1976 (PL 94-444), 
Sy the Comprehensive Employment and Training Act Amendment? of 1977 
<(;PL 95-44), and by the Youth Employment and Demonstration Projects Act of 
-1977 (PL 95-93) has eight titles: 

• * -* Title I authorizes ccaapreheriaive m^power services for thfe unemployed, 
underemployed, and economically disadvantaged. Programs are administered 
by prime, sponsors , which are cities and bounties of 100,000 or more, and 
consortia. The State government la prim& sponsor for the balance of state. 
Funds are allocated according to each area's prior year's apportionment, 
number of Unemployed, and adults in low-income families. Prime sponsors 
must submit an acceptable plan to- the Secretary of Labor* prepared in con-*' 
sultation with local advisory councils. A Stat>e manpower services council 
reviews local plans and arranges for the cooperation of/State agencies. 

Title II provides funds to prime sponsors and Indian reaiervatlona to 
hire the unemployed in areas of substantial unemployment for public service 
jobs. Funds are allotted on the basis of the number of unemployed. 

Title III provides for nationally administered programs for Indians, 
•migrant and seasonal farmworkers, youth, and other groups that are in 
particular need of such services. This> .title also gives the Secretary of 
Labor responsibility for research, evaluation, experimental and demonstra- 
tion projects, labor market information,* and Job banks. 

Title IV authorizes the Department of Labor to operate the Job Corps, 
residential training centers for disadvantaged young men and women. 

Title V establishes a National Commission for Manpower Policy to identify 
goals, evaluate manpower development programs, and make recommendations 
to the President and to Congress. (The Qaergency Jobs Programs Extension 
Act of 1976 establishes a separate National Conanission on Bftployment and 
Unemployment Statistics.) 

Title VI authorizes public service jobs for the unemployed. Funds are 
allocated to prime sponsors and Indian tribes,' basfed on the number of un- 
employed, the unfemployed in eixcess of a 4.5-percent rate, and the unemployed 
in areas of substdntial unemployment. Und^r 1976 amendments, funds for the - 
expanded. Title VI program are in new short-duratio'n projects and most new 
participants must be long-term, low-infome unemployed or welfare recipients. 

Title VII contains provisions applicable to all programs such as 
prohibitions against discrimination and political activity. 

Title VIII establishes a Young Adult Conservation Corps to carry out 
projects on public lands. 

Source: Committee on Evaluation of Employment and Training programs, 
CETA: Assessment and Recommendations (Washington: National 
Academy of Sciences, 1978), p. 4. 
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planning by prociotlng consortia as 6ne way of putting labor markets together. 
The Department of Labor also provides written materials to prime sponsors on 
"how to" plan. But the manpower literature offers only meager support for 
any prescrl^Jtlons or on the effects of different ways if planning. ^Even more 
surprising, the literature does not eXfen offer very rich descriptions of 
various methods of planning. Any specific analysis often assumes there is only 
one right way to plan. 

-The empirical literature on the first few years of CETA experience at^ 
the prime sponsorship levfel makes it clear .that different planning systems, 
do exist, that planning is difficult to generate at the local level, and that * 
the consequen<^es of different^ planning systems are not well known. * . ' 

Our conce^>tion of planning is very broad. We harbor the simple notion 
that any planning system 16 set in a broad local context that directly affects 
both the nature of that system and program results. We also assume that, 
.within broad limits related to the context, the nature of the planning system 
has the potential for affecting prograln results^ 

In a generic sense we regard planning ^s one potentially Imporftnt' 
structured intervention between the contextual factors in a prime sponsorship 
and the results of programs. Theoretically, ""good" planning should result 
In Improved program performance because it will help in the development of the 
most productive programmatic respjpnses to c6ntextual factors and/or it may 
help in altering those portions of the context that are susceptible to 
deliberate manipulation in the short run, 

^ . ' ■ 

There are both more "technical" and more "political" aspects of planning. 
Some parts of plaiming are focused primarily oh the technicalities of labor 
market informatlori and programmatic response whereas other parts more broadly 
assess the needs of the .Community and tjie appropriate prograianatic responses 
to those needs in-broad, nontechnical, political terms.; Our previous work 
-on CETA leads lis to believe that both the . technical and political aspects 
of planning are Important and that they interact with each otiier in 
influencing program results (see Ripley and associates, 1977, 1978). 

■v 

The present research Is set in the context of two previous projects we 
have completed. Between mid-1974 and mid-1976 we examined the Implementation 
of CETA In 17 ptime 'sponsorships in one large State (Ohio) . We produced an 
elaborate map of those 17 ejfperiences and the commonalities we observed in 
them. We also sought to explain those commonalities. (For the final 
report from that project, see Ripley and associates, 1977.) 

Jn 1976 and 1977 we concentrated on a number of broadly defined aspects 
of prime sponsorship management and sought to link management decisions in 
those areas to program goal achievement in 15 prime sponsorships spread 
throughout the country, comparing the experience of the 15 with the 17 Ohio 
cases wherever possible. (For the final report from that project^ see Ripley 
and asisociates, 1978.) ' 

The earlie^ research provides us both with a number of empirically . 
' supported findings that are relevant to our present work and with two <iomparis 
groups of prime sponsorships against which our findings on planning can be 
"tested," at least Intuitively. (There were only two cases^of overlap in 
the three clusters of prime sponsorships used for these studies: two of the 
planning sites had also been visited in the management study.) 
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B> DATA BASE ' ^ * 

; • f \ ^ . . - , . - ' , 

We systematically collected d^a on a number of different elements ' 
the local context for planning > the natiire of local planning > and program 
^ . results In the 12 prime sponsorships in which we worked*. Th6 following list ' 
summarizes those elements: ' * / \ 

I, LOCAL CONTEXT VOR. PLANNING , ^ . ^ 

A. . HISTORY OF TITLE I PROGRAMS 

• ; * • ' * • 

1. CETA budget resources 

Allocation of budget at local level 
\ 3. Distribution of participant? among program components 

A» Past program performance of prime sponsorship ^- , 

5. Characteristics of persons enrolled and placed , * 

6. Service deliverers . ^ 

7. Degree, nature of cha^jge in the employment and training 
delivery systiem*" ^ 

8. Degree, nature of conflicts in the employmeiit and training 
♦ delivery system 

B. LOCAL ECQNQMIC CONDITIONS (LOCAL LABOR MARKET)* 

1. Characteristics of local labor force 
^ 2. Unemployment rate 

3. Current employment opportunities 
'4. Projected employment opportunities 
5. Nature of , unemployment 
• * * 

C. ^ DEMOGRAPHIC CONDITIC»IS IN PRIME SPONSORSHIP 
^1. Characteristics of general population 

2. Characteristics of those most in need of manpower services 

D. CHARACTERISTICS OF CETA STAFF 

1. Administrative location of CETA units 

2. Staff organization ■ ' . 

3. Attitudes /commitments of staff 

4. Professional qualifications of, staff ^ 

E. CHARACTERISTICS OF PRIME SPONSORSHIP 

1. Jurisdictional type 
2« Local* decisionmaking patterns 

F. HISTORY OF TITLE I PLANNING! 

1. Staff attention to plwining over time^ 

2. ' Staff cooperation with other planning agencies 

3. Change in planning over time 

II. NATURE OF LOCAL FUiNNING 

A. STAFF CONCEPTION OF PLANNING 

B. LOCAL GOALS OF THE CETA PROGRAM 
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C. TARGET GROUPS .TO BE SERVED ' 

E. . IDENTIFYING JOB OPENINGS 

F. PRESCRIBING A MIX OF SEtWICES • 

G. SERVICE DELIVERERS' SELECTION, 

H. MOtllTORING AND EVALUATION PROCESSES 

I. ! USE OP H0NIT0RIN6 AND EVALUATION * . 

• J. PUBLI? PLANNING PROCESS 

* K. STAFF TIES WITH OTHER PLANNING UNITS ^ 
' L. SEPARATI0N/INTB6RATI0N OF PLANNING AND OPERATIONS 

• M. S^ARATION/INTEGHATION OF TITLE I PLANNING WITH OTHER CE£k 
PLANNING ' - / 

' N. -USE OF SOCIOECONOMIC DATA IN PLANNING 
III. PROGRAM RESULTS j 

A. LOCAL GOAL ACHIEVEMENT 

B. OCCUPATIONAL TRAINING AREAS . 

C. PARTICIPANT CHARACTERISTICS 

1; All enrollees 
2. All persons pl&ced 



\ 



^. Local significant segment groups 

* ft 

D. PROGRAM MIX 
^ E. PROGRAMMATIC INTEGRATION 

F. STANDARD PERFORMANCE MEASURES (PLACEMENT RATES AND' COST) 

G. QUALITY OF PLACEMENTS 

H. - NON-CETA LINKAGES 

Data of four kinds were collected: 1) quantitative data such as that 
contained in priine sponsors' quarterly reports; 2) a wide variety of information 
contained In documents such as local plans, modifications, and public informatlpn 
releases; 3) perceptions, obsei^vations , and opinions of indivi4uals involy^^ 
CETA systems at the local level; and 4) direct observation by the^^pearchgts 
of specific processes such as advisory council meetings. 

We got the needed data in the first category from the national office of 
the Bnploymearand Training Administration. We pollected the data in the 
second categSy from the files of the 12 prime sponsorships. 
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> I , Data In the third category wer&^ollected In over 4.00 Intervlenrs In 
the 12 prime aponsorshlps |flth Indlitldtlals of eight kinds: 1). the director 
of the CETA staff and the Jjilef planner; 2)' other professional CETA staff 
members; 3) ^ployaent Settee officials who Interact with CETA In plannlng'J ' 

4) other local planners %^o Interact with CETA In planning (for ea^ample, 
planners for the chamber of commerce or a regional planning commission) ; 

5) the most' Informed and active members of the advisory council; 6) the 
Federal repres^tative for the prime sponsorship; 7) service, deliverers; 
and 8) political officials". 

- « 

Data In the fourth category, came' from observation of abotut 50 different 
meetings (staff meetings, plaoinlng staff meetings^ advisory council meetings) 
In 'the 12 prime sponsorships. • 

. ■ _ . k 

C. SITE SELECTION AND DESCRIPTION ' : . 

• * 

In choosing 12 sites for field york we wanted ppLsne sponsorships that 
were at least reputed to take Title planning seriously* We used three 
prlniary sources for arriving at an initial list of "nosilnees." 

Flrsj^y we contacted a number of people knowledgeable about planning In CETA 
to describe our project and ask. for their nomlnationis. These Individuals Included 
staff iBembers of the National League of Cltles-U.S. Conference of Mayors; the 
National Association of Counties; the National Manpower Commission; regional 
ETA offices; Institutional Grant universities; other research organizations 
that have studied aspects of CETA (the National Academy of Sciences, the Manpower 
Development Corporation, and IMPACT); anld Individual prime sponsors « 

Second, we went through all'^of the published and unpublished literature 
on CETA In our files to look for possible sites. 

Third, we reviewed our own files on 32 prime sponsorships In which" we had done 
Intensive field work; ^ 

From these "nominations" we chose a purposive sample that would maximize 
variation In 1) the type of prime spotisorshlp;'^ 2) the general economic 
position of the prime sponsorship; 3) size pf the prime sponsorship In terms of 
dollar allocations; and 4) geographic spread • 

Type of Prime Sponsorship 

For purposes of both planning and linking planning to operations^ the 
major difference Is between multiple Jurisdiction pi;£me sponsorships (consortia) 
and single Jurisdiction prime sponsorships (cities and counties). Our sample 
of 12 Included seven consortia and five single jurisdiction prime sponsorships* 

General Economic Situation 



We looked at two general aspects of economic situation: economic health 
as measured by unemployment and position In a labor market. Seven of our 
prime sponsorships had unemployment higher than the national average, with 
two of those seven being well above average. Five of our sites had unemployment 
lower than the national average, with two of those five being well below 
average. • Our sites were a^^out evenly split between those that dcmlnate a 
labpr market and those that are only part of a labor market* 



size of Program 

— ■ * 

We used the dollar amount of Fiscal Year 1978 Title I allocations (before 
consortlma Incentives) as an Index of progr^ size. Three of our prime sponsor- 
ships fell between $7.8 million and $13.8 million. Three fell between $3.7 
million and $5.6 million. Three fell between $2,8 million and $3.0 million. 
And three ^11 between $1.2 million and $2,2 mllllpn. We excltided prime sponsor- 
ships with an allocation of. less than $1 million from consideration da sites. 

• • • * 

Geographical dispersion . ^ ^ 

We had at least one site in 9 of the 10' Federal regions and had a second 
site in three of the larger regions. The only region in which no site was 
selected was Region V. - This was the case for two reasons: First, none of 
our . contacts nominated a prime sponsorship in this region for study; second, 
we kn^w 18 prime sponsorships in the region well .already ^d could use them for 
purposes of tOT^arison with our 12 sites on some points. 

Sites Chosen 

Our first twelve preferences all agreed to participate in the project. In 
each case we contacted the staff director and explained the nature of the 
project and the nature of the field work and , solicited his or her cooperation. 
JChe field work was conducted in the following prime sponsorships: 

♦ 

Penobscot Consortium, Maine 

Syracuse, New York 

Bergen County, New Jersey 

Baltimore Consortium, Maryland 

Atlanta, Georgia 

Heartland Consortium, Flc(rlda 

Gulf Coast Consortium, Texas 

Albuquerque Consortium, New Mexico 

Omaha Consortium, Nebraska 

Denver, Colorado 

San Fr^cisco, California 

Klng-Snohomlsh Consortium, Washington 

Table 2 contains some suomary information on these prime sponsorships. 
Appendix A contains a short description of some of the most Impprtant aspects 
of what we observed in each of the 12 prime sponsorships at the time we visited 
(Indicated on Table 2). It should be underscored that some features in these 
12 sites were no doubt different before we took our snapshot and have 
probably changed since. 

D. ORG ANIZATION OF THE REPORT 

7 ^ 
' Three major analytical sections follow. The first focuses on planning 
systems, including the effects of local context on the nature of planning. 
The second focuses on explaining program performance. The third discusses 
exemplary approaches to critical elements of planning and management. A short 
concluding section offers some simmiary comments. 
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Table 2: INF^MATION ^ BTSEARCH SITES 



- » 


Name of Prime Sponsorship 

K ■ # 


Federal, 
Region 


Type of Prime 
Sponsorship 

* 


1 FY 78 Title I 
1 Allocation 
1 (without 
cbnsortlua 
j ^ Incentive) 
(In $ millions) 


Jupe 1977 
Unemploymetit 

Rate (Nat. 
ayerage^7.5) 


Period of Primary 
• Fleid Visits in 1978 

% 

• 




jreixODscor Loixsort4.uin) Haxne 


I 


Consortium 


1 

1.21 


• 

'7.6 


Summer 




Syracuse 9 New York 


XI 


City 


1.66 


8.0 


Sumnier 




Bergen County y New Jersey 


II 


County 


' 5.61 


7.9 


Spring. 




Baltimore Consortium, Maryland 


III 


Consortltun 


13.84 . ' 


6.8 


Summer 




Atlaxita, Georgia 


* IV 


City 


5.26 


8.0 


Spring 




^Heartland Consortium, Florida 


IV * 


Consortium 


2.90 


8.8 


Spring 




Gulf Coast Consortium, Texas 


VI 


Consortium 


2.17 


* 

A.8 


Spring 

• 




Albuquerque Consortium, N.M* 


VI 


Cdnsortltmi | 


2.78 


8.4 ' 


^xjom&er 




Omaha Consortium, Nebraska 


VII 


Consortium 1 


2.96 


3.9 


Summer ^ 




Denver, Colorado 


VIII 


dity 


3.68 




Spring * 




San Francisco, California 


IX ^ 


City 


7.77 


9.6 


Spring 




King- Snohomish Consortium, Wash* 

ft 


X 


Consortium j 


11.00 


6.7. 


Summer 


ERLC 
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II. PLANNING SYSSiMS 



I The purpose of section II is three-fold. First, .we will briefly discuss 
the nature of planning in general. Second, we will dteyelop three models of 
planning systems. Third, we will elaborate on the empirical referfents for those 
thr^e Bodels. Fourth, we will discuss the effect of context and management, 
decisions on planning. ' ' 

t ' , - ■ ■ • . 

A. T^E: NATURE OF PLANNING . 

We view planning activities as a specific subset of general management 
activities. Thus planning declsjLona are a subset of general manageyent 
decl8lons\ The p],annlftg declsldn-^maklng process Is a special Instance of 
genetal management decision-making* Both management and planning activities, 
decisions, and Beclslon-maklng processes are set within a general context / 
The following figure suggests the inter-relatlonshlps between generaJL context, 
management decisions, and planning decisions* The following points should be 
especially noted: (1) managaaent decisions Include planning decisions, (2) 
planning decisions are separable from management decisions for purposes of 




analysis, and (3) from the perspective of planning decisions, context — represent«i 
by the shaded area In the figure — rconslsts of both general context and managementr 
decisions* 

Planning- decisions cover five major areas: 

— Identification and choice of local goals; 

— Identification and choice of participant target groupa to be 
served; ^ * 

— identification of target occupations for training and placement; 

— identification and choice of program mix; and , ^ 

— identification and selection of service deliverers who are to 
deliver the training and employment services.. 
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These decision areas are defined broadly In each case, so that the 
service deliverer decision area, for example , Includes not only such decisions 
as which deliverers to fund, but also of Whether to use an RFP and whether to 
contract or operate services In-house* 

We have limited what mean by "planning" to that which Is Included In 
thes^ five decision areas knowing that alternative definitions of planning are ^ 
possible. Others, for example, have separated planning into strategic and 
operational cosq^onents. The merit of the five decisions Mte have selected is 
that they exactly cover all of the basic choices that must be made to 
accomplish the goal any prime sponsor must address, namely (in the words pf the 
statute) that of providing "job training and employment opportunities for 
economically disadvantaged, unemployed, .or underemployed persons which will 
. result in an increase in their earned income. ••" By clearly separating the 
,wflve decisions that determine who is to be served, with what services, and 
for placement into which jobs, we can th<bn examine the remainder of the . . 
program for influences on these decisions. 

Conversely, if we were to define planning as extending over, all management 
decisions, we would lose focus on the essential questions unique and basic to 
employment and training matters, and cross into what would become a wider 
study o^ program management. The concrete implementation of decisions, for 
example r is not considered in this analysis as part of planning Itself, although 
implementation is without doubt closely related to planning and in fact often 
performed by the same staff. 

Management decisions Include all planning decisions, as well as other 
decisions necessary to organize. Implement, and operat.e an employment and 
training program. Examples of manag^ent decisions include those categorized 
as planning decisions and other* decisions such as arrangements to manage 
actual or potential conflict; choice of nature axki use of monitoring and 
evaluation of programs; and the nature of staff relations with such key actors 
as political officials, advisory council members, and service deliverers. 
These management factors are Important in considering planning because they 
form part of the context of planning decisions and thus may influence theaw 

Gendi^al context consists of conditions external to the CETA program and 
generally not open to short^run change through the actions of the local program 
staff, although some of thej^ may be manlpulable in the long run. Examples 6f 
such factors are economic conditions, the history of employment and training 
programs in the locality, and the structure of local government. The general 
context is important jmsofar as it Influences the nature of planning. 

Our purpose, at the most general level, is to explain how and wAiy prime 
sponsors plan. We began with the belief that the nature of prime sponsor planning / 
is Influenced by two factors: the general ^context and general management 0 
decisions. Testing this assumpt^ion led us*to pose three central questions, . 
which are discussed in sections that follow: - 

1. What major variations exist in the nature of planning decisions? 

2. Which factors in the general context and in the set of management 
decisions are important Influences on th# nature of planning and 
which are not? 

3. How do' the important factors influence the nature of planning? 
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B. MODELS OF PLANNING , • 

To associate contextual factors and management decision factors with 
differing methods of planning, we first analyzed the nature of planning in 
the twelve sites we studied. - ' 

f t* . , 

Five dimensions of variation were utilized and applied each of the , 
five planning decision areas. Selection of each of these five variables 
was4>ased on preliminary, analysis that considered a wide array of„planning 
system characteristics and selected' those that occurred most frequently and 
with greatest significance. , 

. . ^ ~ 

Stability of relations" among actors, , the first dlmenialon, was analyzed 
according to which actors participated Ift each decision; the extent and 
consistency of their influence; and the reasons for their influence. Overall 
stability across decision areas was 'Also exaadLited. 

Conflict over planning decisions was similarly analyzed j consld|erlng not. 
only the level of conflict but also how well conflict was managed and channeled 
to productive ends. We observed that siost sites had declined in overall level 
If conflict when reports for FY 1978 w6re compared to repprts for 1974 and 1975, 
when local decision-making ipatterns were being established. But there was some 
variation In 1978 too. 

Degree of rou^^^Ln planning is a sussiary measure that takes Into account 
the presence of de^H|Knaklng routines and their success. Such routines 
Included regular us^^TEFPs, substantial reliance on the advisory council, 
and the development and use of standard data analysis formats. 

Feedback mechanisms were assessed along two lines: whether they were 
present and whether they worked. They were interpreted to include both hard 
(for example, MIS, formal evaluation) and soft (for example, rell&rice on Informal 
reports from J ob^, developers) variations. 

Deliberate attention to long-range decisions, the fipal dimension, was 
defined as decision-making that looked beyond the 1-year time span. . To be 
assessed positively on this measure, a prime sponsor was required to display 
regular all^Aatlon of program resources to the function. 

On the basis of the major variations we observed, we constructed three 
general models oi planning systems. We labeled these three models Crisis 
Management planning. Operations Management planning, and Future Oriented 
planning." The broad relationships among these three models are sunanarlzed 
* In Figure 1. * 

« 

It should be noted that these models are derived from 12 prime sponsorships 
that were reputed to take planning seriously. In our other studies we have 
come across a number of sites In which planning is quite rudimentary and, in 
many important senses, nonexistent. Thus a fourth "model" is implicit: No 
Consistent Planning. However, since we are dealing with sites In which at least ^ 
some consistent planning was observed to take place, we limit ourselves to 
discussing the contexts" for and results of "these three models. But we are 
got asserting that all prime sponsorships in the country necessarily fall into 
one of the three categories. At minimum, a number would fall into the No 
Consistent Planning category. Also, there" may well be a higher proportion of 
Crisis Management prime sponsorships in the country than is indicated by our 
identification of only 1 of our 12 sites In that category. And there is 
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Dimension of 
Variation 



•Stability of rela- 
tions among actors 



Conflict over 
planning decisions 



Degree of "^routine 
in planning 



Feedback 
mechanlsiBs 



Deliberate atten^ 
tion to loiig^-range 
decisions 



Crisis 
Management 
Model 



unstable 



umaanaged 




lack of 

successful 

routines 



absent or 
malfunction- 
ing 



none 



, operations 
Manageioent 


Future 
Oriei&ted 
















well-managed 


well-managed 


many 

routineer 


many 
routines 




in t>lace and 
utilized 




and 



none 



^ important 



Figure 1: CHARACTERISTICS OF PLANNING MODELS 
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probably a smaller proportion of Future. Oriented sltea than Is Indicated by 
out identification ^ 25Z of our sites fitting that model. In short, we do 
not claim that tie Sreakdown of 'our 12 sites* reflects the breakdown among all 
460 prime sponsorahips. In fact we would guess that the proportion of No 
Consistent Planning -sites is substantial, the proportion of Crisis Management 
sites is larger, and the proportion of Future Oriented sites is smaller. 
This would also ma-an a smaller proportion of Operations Management sites. 



In the Crisis Management modpl the influence structure is highly 
unstable. Actor influence changes from iioment to moment, and from <»ejislon to 
decision. Little trust and stability In conmunicatlon are present. In addition, 
i^en conflict arises, which la often. It Is'unmanaged (that Is, thete are no 
routines established and accepted for caiflict resolution). A critical ^ 
characteristic of the Crisis Management system is the malfunctioning of the 
information feedback system. While «ood qualitative and quantitative information 
may in principle be available, without a feedback pipeline the information will 
not be utilized' to make important decisions. In sum, the Crisis Management 
planning system is characterized by a reactive decision-making Procp^ that 
focuses, of necessity, on unpredictable problems, often organizfljipal in 
character, that continually emerge from an un^able envlrottment. No patterns 
of influence are established among actors, and a generally diaotlc system seems 
to prevail. But, even in the midst of turmoil, planning is not abandoned. 
This fact creates a model of planning, instead of a model of not).-planning. 
. . ■' . ♦ • ■ • ■ 

In contrast, the Operations Management system Is characterized by ^ 
stable and well-oiled influence structure in which actors recognize their own 
and other actors' Influence positions. In addltipn, conflict is weU managed 
(that is, routines for resolving conflict are established, accepted, and 
practiced). Planning activities, whether qualitative or quantitative, _ 
generate Important information, organize it, and conmuntcate it to the important 
decision-making actors. A feedback operation is in place and is utilized. 
Finally, the decision-making process focuses mainly on short-term performance 
with a time frame usually a year or leas- in length. ^ 

The Future Oriented planning model differs from the Operations Management 
model only in its deliberate attentjion to long-range decision areas. Future 
Oriented planning systems will not necessarily have any different or better 
monitoring systems. Both qualitative and quantitative information is gathered 
and fed back to Important actors so as to improve ongoing prog^ms in an 
incremental- fashion. Yet, the Future Oriented system ^^"^ts j|kgnif leant 
organizational time, energy, and capital, boi:h human and finan^l, into the 
mapping of strategies for lonfr-rang6 goals covering a number of years in the 
future. 

Implicit in the nature of our models is the judgment about what characterizes 
the quality of planning systems. Clearly, the. Crisis Management model charac- 
terizes a system that all prime sponsors wish they could avoid. Unstable 
Influence patterns, unmanaged conflict, and inoperative feedback processes are 
all marks of a system in chaos that can have little hope of fulfilling the 
goals of a CETA program. However, while prime sponsors would certainly rather 
be In an Operations Management or a Future Oriented system, it is not clear- , 
whether the Future Oriented model, is necessarily preferable to the Operations^ 
JS^ag^ent moSel in all cases, contexts, and times. It may be that at a certain 
point in the prime sponsor's development most long-range goals have. been 
sufficiently accomplished and the continued extension of organizational 
resources into an ongoing Future Oriented part of the staff may be inefficient. 
The prime sponsor may make the best use of resources by just focusing on 
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csigoliig prograas vlthln annual plans. 'This does not aean that at some future 
point It would not be\e£flclent and Haportant to aid the features of Future 
Orientation to the Existing accoaipllshments of the Operations Management model, 
y • . hold the Future Orientation In place long enough to Iniect additional planned. 
cHange Into the system and Institutionalize It, and then revert to the 
, Operatl^ms Management of the nov Institutionalised gains. The latter two 
models In this Interpretation would vary In preferahlllty according to the 
needs and situation of the prime sponsorship. . 

There are not only one or two "good" sets' of planned activities and 
ways of adapting to actor Influence that .should be apijlled across all prime 
sponsors. In' all contexts. Some types of planning activities and some types 
of Influence structures will be effective In stme contexts while no^ In others. 
For example* a very sophisticated, highly quantitative monitoring system may 
be essential for good planning and decision-making In a large prime sponsorship 
with numerous^ service deliverers . Yet , .in a much smaller prime sponsorship , 
one with only one or two service deliverers, a less rigorous monitoring 
system based largely on qualitative Information may work quite well and 
resources may, in fact,^ be wasted on a more sophisticated system. However, 
If no monitoring system exists and there Is no feedback to decision-makers 
on how well programs are operating, then a Judgaent can.be made that the planning 
system Is not functioning effectively. And to the extent that planning Is 
Important. for good decision-making, then the decision-making- process could also be 
Judged to be poor. 



) C. pglRICAL BASIS OF THE MOD ELS 

The three models We have described have been characterized by variations 
along five dimensions. TheSe five dimensions represent > and summarize variation 
along two lines: differences by site and differences by nature of planning ' 
activities. The differences we observed will first be discussed by site, 
, Illustrating the characteristics of sites that are grouped according to 
their placement^ In the. models. .Differences will next be discussed ^y nature 
of planning activities. , 

Differences Among Sites 

^ Crisis Management . Denver was the only site of our 12 that, in our 
Judgment, clearly had a crisis orientation. At one time It had had a system 
more like the Operations Management model but It slipped Into the Crisis 
Management model as the system underwent significant change. There has been 
high turnover in the professional staff concurrent with expansion of both program 
and staff size.' This led to substantial d^nands on remaining staff, leaving 
little time for planning. Planning under these conditions was reactive and 
involved the resolution of the problems of the day. Subcontractor^ view the Denver 
Employment and Training Administration with substantial 4isrtrust, and there is 
little coordination of the subcontractors in what is. intended to be a highly 
' organized program. Thus, when conflicts do arise i they are often unmanaged, 
and the influetu^e struggles that ensue Indicate that influence patterns are highly 
unstable. There has been no regular monitoring and/or evaluation of performance. 
Finally, key staff are striving to build a stable system in which there is a 
noncrisis atmosphere; they are aware of their problems and are working hard to 
correct them. 

I 

• ' *- 

Operations Management . Eight of our sites fit the Operations Management 
N plalming model: San Francisco, Bergen County, Gulf Coast, Heartland, Atlanta. 

14 
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Ottaha» Klng-Snobio«lsh, and Albuquerque. Sosae sites deajrly fit this model, 
others less 80» iand still others seem to be In a state of transition to one 
of the other models . Hovever , all eight sites had enough characteristics In 
comon that we were convinced that they all approximated this model. 

San Francisco in some ways fits the Future Oriented model because it 
does acknowledge the importance of long-range planning. This concern, however, 
is more of an aspiration than reality. San Francisco, therefore, fits most . 
closely into Operations Hanagement. * It could easily move into the Future 
Oriented model, given conditions that would facilitate such a shift (for 
example, more time for planning and a larger^ planning staff) . 

• ■ • . . ■ ... 

.King-Snohomish, on the other hand, is in a state of flux that suggests - 
movemenT~%oward the Gtlais Management^ orientati9n becasue of some ^upheaval 
at key staff levels. . The change in staff has resulted In the injection of 
some Inexperienced actors into the planning process, which presented sonte 
problems but thus far has not threatened the' viability of the system in place. 
' Relations between key actors (service deliverers and staff) have historically - 
been stable and remalfi reasonably so. Feedback has been provided, both .for 
service deliverers and staff, by mbnltorln^>and by continually developing the 
MIS. Conflict has been, controlled by a strategy of Incremental program changes 
and an elaborate decision-making process. In sua, although the consortium is > 
^ixperienclng some problems, the systemThas not become simply reactive to the 
problems of the day, shut, continues to perform in a manner best ^characterized' 
by Operations Hanagement. ^' , ' 

Other sites more clearly fall into the Operations Management model although 
the methods for achieving similar end resiilts differ. For example, Omaha has a 
relatively sophisticated (in' terms of use of qu^itatlve data) monitoring 
system'. In contrast, the Gulf Coast conaortlv&does not have a rigorous 
monitoring Isystem, nor does it appear to be necessary at that site; staff 
menibers are in frequent conti^ with service deliverers and handle most 
problems informally before formal monitoring visits are made. In Atlanta, ^ 
monitoring is a routine, rigorously systeaatic operation. Bergen County, 
Heartland^ and Albuquerque monitor in other similar ways. All sites in this cluster, 
however; do provide feedback to service deliverers arid staff (and other actors 
if relevant) so that adjustments can be made. In all cases it appears that, 
whatever the form of the monitoring procedure, good monitoring is essential 
to the Operations Management model. 

Conflict, when it occurs. Is well managed in most Operations Management 
sites by careful planning by prime sponsor staff. The desire to manage conflict 
is frequently among the coianitments of other key actors. In addition, all 
actors recognize their own influence position and accept some basic rules 
for conflict resolution. In San Francisco, for example, conflict emerges 
occasionally when service deliverer selection is being pursued; staff carefully 
builds its case based on quantitative data that give legitimacy to staff 
positions and can facilitate resolutions of conflicts. In Gulf Coast, the 
prime sponsor staff pres^k^ a "business like image" that seems to put the 
agency "above politics," and"lislice, probably minimizes confllctual situations. 
Conflict is managed in Heartland by anticipatory decision-making coupled with 
the administrative and political skills of the employment and training 
director. Other sites structure their planning systems to minimize the 
• potential for conflict, 
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Xn all eight sites » critical actors, although they may vary in nuxobers 
smi types, have established relatively stable- techniques for Interaction with 
one another, and various routines for deblsion-making have been worked out. 
Although there are some interruptions in these process^, there is relative 
stability in the decision-making system (including the planning process). 
The focus, in all eight ^ites, is on Improvement of the system by making 
Incremental adjustments. The primary emphasis is on short-^term planning with, 
perhaps, -occasional attention to a longer range future, although no regula«u^ 
and systematic attention is paid to it. 

. t ^- * 

Future Oriented. Baltimore, Penobscot, and Syracuse are most appropriately 
characteri2^ed by the Future Oriented model. They all manifest the characteristics 
of the Operations Management model, but they also are regularly concerned with 
Issues that go beyond the 1-year time span. Baltimore expresses its concern 
with the future by maintaining a highly stable Operations Management system in a 
clitnate of awareness of the long- range effects of short-term decisions; an 
ea^ple of this concern is the establishment of the Labor Market Advisory 
Councils (which are representative of the private business community and could 
have long-term Impact). The Penobscot Consortium consciously pursued long range 
goals jAien it made the decision to redirect the efforts of the acaployment and 
training syst^, and most actors continue to articulate long-range goals as 
critical to the planning operation. In Syracuse, some staff members are assigned 
the rfesponsibillty of dealing with long-range concerns; the regular attention 
to economic issues is a key example. In all three cases, there are highly stable 
relations between critical actors \9ho perform their responsibilities in a 
routlnized, and, perhaps more Importantly, accepted manner. Planning is closely 
linked with operations (although operationalized somewhat differently in 
Penobscot where the major portions of the program are run in-house). These 
characteristics have effectuated an environment characterized by low conflict 
between actors, and therefore, the freedom to engage in future oriented 
concerns. . _ 

Generalizability to Other Sites . Given the purposive nature of our 
selection (described in Section I) it was not unexpected that most of the sites 
cluster within one models The quality, details, and functioning of the 
planning systems we observed varied a good deal, however. Thus, to reiterate 
a point made earlier, we do not claim that our three models are necessarily 
exhaustive. On the (fther hand, not only do they fit the observations at our 
12 sites but they are also intuitively pleasing when placed in an unsystematic 
way against pur experience in the 32 sites visited previously. 

Differences in the Nature of Planning 

We examined multiple dimensions of the nature of planning at each site. 
These dimensions can be broadly separated into two classifications. First, 
we examined differences in actors participating in planning decisions* Second, 
we analyzed the group of factors describing the manner in which each of the 
five decisions is made. 

In assessing the influence of actors we relied on the judgments* of 
two-person teams that spent 2 weeks In each of the 12 sites conducting a 
large number of interviews, observing meetings, and collecting doouaentary data. 
We attempted to identify actors that had either a hlfeh degree of influence or 
a medium degree of influence. - The residual .category was little or no influence. 
Reasons for influence included (1) control over funds for services, (2) access 
to generating political support from an identifiable constituency, (3) control 
oyer or special access to information, (4) access to special fonmis 8uc||||^8 the 
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advisory council where pressure could.be brought to bear on other actors, 

(5) strong Interest In and coBmltment to achieving a specific decision, 

(6) personal skill at bargaining, (7) default (no one else was much Interested), 
and (8) control oVer a prior decision that pre-dfetermlned the outcome of a 
succeeding decision or decisions. When dlf f erences* In findings from this 
analysis are summarised, the results lead to judgments on the first dimension 
of the planning models, stability of relations among actors. . ' 

In the second section we look at five decision areas: local goals, 
target groups, target occupations, program mix', and service deliverers. In. 
coraaenting on each area for decision we have considered a number of characteris- 
tics of activity In that area: (1) degree of openness In the process, (2) the 
use of socioeconomic data, (3) the use of monitoring and evaluation data, 
(A) the use of political considerations, (5) the formality of the processes 
* used, (6) the degree of conflict present, and (7) the degree of change In programs. 
These factors, when collapsed across the five decision areas Into suBamary 
measures, lead to ratings on the degree of routine, use of feedback, conflict 
management, and long-range planning dimensions of the planning models. 

' ' Influence Structure Patterns . It is worth noting that, in general, the 
only actors actively engaged in the planning process at any site were prime 
sponsor staff, service deliverers, advisory councils, and political officials. 
These actors were present or absent in different configurations and with different 
strength in different" locations and different decision areas. This generalization 

^ underscores the local nature of decision-making. In only one case was the 
employment service Important in making any planning decisions and in no cases ^ 
were representatives of the Employment and Training iidmlnlstratlon important. 

We found, as we expected, that staff actors were generally most important, 
usually because of their control over information. Important variation existed. 
In the Crisis Management site, staff members were significantly less dcmilnant 
than in other sites and service deliverers were very important. At the other 
extreme, staff members were active in all five decision areas in those s^tes 
we termed Future Oriented sites, and very seldom shared their Influence ^Ith 
other actors. Service Deliverer Influence, in addition to staff Influence, 
was conaaon in sites that we called Operations Management sites, where it . 
clustered most significantly about the Service Deliverer Selection and Program 
Mix decision areas. Advisory council influence was found most frequently on 
the selection of target occupations and on selection of service deliverers, ^ 
although. the type and level of council Influence did not strongly associate with • 
other factors. Political official Influence appeared in some areas but was not 
frequent. It should be noted,^that the Infrequent participation of political 
officials in decision making may mask the greater indirect Influence these 
officials actually may have because of anticipatory decision making by the 
staff. 

Planning Decision Areas . In the Local Goals area, we found a closed 
process in which staff based^ goals on value judgments with little use of, data. 
Although there were variations on this pattern, they were not as numerous as 
variations in other decision areas. Future Oriented sites tended to have more 
specific long run goals, although they were not usually formallV "stated. 

The Target Group decision was most commonly the focus of attention by 
staff, service deliverers, and advisory coimcll members, who made high use of 
socioeconomic and monitoring/evaluation data. Seven of 12 sites shared 
a pattern of use of political considerations, service deliverer participation, 
use of formal process, and Iw use of monitoring /evaluation data (only one of 
these is a Future-Oriented site). This pattern suggests that the Target Group 




decisloa, because it directly affects allocation of resources, la next moat 
controversial after the Service Deliverer Selection decision, and therefore 
received serious consideration* 

The Target Occupation decision was treated at nost sites as .a technical 
.one. Little non-staff participation was noted. Data were highly used. 
Stibstantlal change Ini&ethods over time was noted, with change in three of 
the sites Involving systematic Introduction of business representatives Into 
the decision. Two of these three were Future Oriented sites. 

The Program Mix decision split Into two fairly clear patterns: one In 
which It was derived from other decisions and made with Input, from service 
delivery agencies, and another In which staff decided the Issue and applied it 
to the Service Deliverer Selection decision. The first pattern was more 
. frequent, with the second appearing In the three sites we labeled Fuxure 
Oriented. 

V ■ 

""' The Service Deliverer Selection decision likewise displayed two patterns: 
three sites selected deliverers with low use of poetical data and a closed 
decision making process (the Future Oriented sites) while a majbrlty of the 
others used political coloslderatlons In more open systems with high Influence 
of service deliverers and advisory council members. 

D. THE EFFECTS OF CONTEXT ON THE NATURE OF- PUNNING 
it ■ _ • ■ 

Mlhy dfr-^lKi^ sponsors plan as they do and not in some other way? Do prime 
sponsors have the flexlhlllty to choose how they plan their pro^rams^r Is 
the nature of planning largely imposed by contextual conditions? Iiulght Into 
.these Issues requirea; an examination of how context affects what gets planned 
and how It Is planned. That Is the purpose of this section. 

I 

Complexity must characterize any Investigation of the effects of context 
on the nature of planning because of two factors: the large nunber of possible 
cont^tual Influences and the interrelationships among th^. The first point ' 
Is obvious. An Illustration will clarify the second. The nature of the local 
economy and the quality of program staff are both cont^tual factors. Each may 
^ influence the nattire of planning. Under certain conditions these two may cancel 
each other, leaving no net effect on planning. Th^ net' effect, however, is all 
that is apparent to the observer. Separating the Interaction between the 
constraining effect of the economy and the facllltallng effect of the good staff 
Is not readily possible. Fortunately, the effect of axfy one factor Is not of 
primary Interest. We are, instead, concerned with identlfylfig the pattern of 
contextual characteristics within which "good" planning Is found, and examining 
them In order to determine the feasibility of making Intenrentlons that extend 
"good" planning to greater numbers of sites. ^ ^ 

Investigation must therefore accomplish two tasks. It must select the 
most important from among many potential Influences. Second, it oust consider 
their net impact on the nature of the planning system and explore how this 
pap&ct is exerted. 

Selection of Contextual Variables ' 

in 

^ ,,.^e have defined the context for planning In an- earlier section of this 
repott. It will be remembered that the environment for five decisions that 
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compose planning consista of tsro elements f general context and management 
decisions. The general contexit consists of conditions external to the program 
and not generally open to short-run change. Management decisions, because they 
determine the general climate within' ^ich the program is operated, are the 
second half of the environment for planning. This distinction is useful because 
factors in the general tontext are on the whole less subject to manipulation .i 
than management decisions. Selection of indicators to represent each of these 
elements was based on three lirlnclples. First, we examined factors that had 
been Identified in previous research. Second, we analyzed factors that were 
mentioned during our site work with sufficient frequency to suggest their 
potential Importance. Third, we have included some indicators to test the 
validity of certain operating assumptions offered to us by manpower practitioners. 
We are interested In each variable tq the degree that it affected the nature 
of the planning systaa. (The effect of context on performance is examined 
separately in a later section.) 

General Context — Elements • 

Four groups of indicators (nature of local economy, nature of local population, 
program size, and organizational nature) comprise those selected to Indicate 
the general context. The nature of the local economy, a factor clearly beyond the 
immediate control of the program staff, is measured by* three variables. The 
first of these Is the local unemployment rate. To minimize the effects of 
variations over time, an average rate over five selected quarters (6-75 through 
9-77) has been used. Note has been made of which sites are Future Oriented (FO) 
and Crisis Management (CM) sites. Where no such note is attached, the site is 
an Operations Management site. As will be apparent, no strong pattern of 
association in this and other general context variables between the variable 
and the type of site emerges. In the present case. Future Oriented and Crisis 
Management sites are distributed over much of the range of unemployment rates. 



« 

12 STUDY SITES ORDERED BY AVERAGE 
UNaiPLOYMENT RATE OVER 5 QUARTERS 
(6-75 through 9-77) 



V 


Gulf Coast 


% 4.3 




Opaha, 


6.4 


CM 


Denver 


7.4 




U.S. AVERAGE 


7.8 


FO 


Penobscot 


7.8 


FO 


Baltimore 


7.9 




Albuquerque 


8.3 




Bergen County 


8.6 




Klng-Snohomlsh 


9.0 




Heartland 


9.4 


FO 


Syracuse 


9.4 




Atlanta 


10.7 




San Francisco 


10.7 



Growth In the local economy Is the second indicator representing the nature 
q| the local economy. Figures were derived from reports of the Bureau of Labor 
Statistics. They represent ratios of the nianber of jobs present in 1977 to the 
same number in 1970. Data for two sites (Penobscot and Heartland) were not 
/ available. 
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- 10 STUDY SITES QRDESED BY GBONTH IN 
NOMBER OF JOBS IN THE LOCAL ECSmoSi 
1970—1977 





Gulf Coast , 


45Z 




Albt^uerque 


43Z 


CM 


, Denver 






Atlanta 


2QZ 




Klng-Snofaomish 


16X 




ODiaha 


16% 




' San Francisco 


lOZ 


FO 


Syracuse 


8% 


FO 


Baltimore 


7Z 




Bergen 


0% 



It Is Interesting to note that the twof Future Oriented sites and San .Francisco , 
the Operations Management site closest to Future Oriented status , had low growth 
rates; iHille Denver and Klng-Snohomlsh, the Crisis Manag^oent site and the 
Operations Management site most similar to It, enjoyed relatively high rates 
of growth, a counter-In ti\ltlve pattern. 

♦ 

Sl^>le aggregate measures of the nutaber of jobs Ixi an economy may mask 
Influences that arise frcra the distribution of those Jobs across various 
occupational sectors. To examine this possible contextual Influence on the 
nature of planning, we obtained Information from the BLS' Employment and Earnings 
reports on the proportion of workers In local labQr market areas were 
employed In service occupations. (Service occupations were selected as an 
Indicator for distribution of Jobs because placement of CETA participants Into 
these Is typically less difficult than placement Into other sectors. ) Data 
were missing for Penobscot and Heartland. 



10 STUDY SITES ORDERED BY Z WORKERS 
IN SERVICE OCCUPATIONS (1975) 



< Albuquerque 24 

FO Baltimore ^ 22 

San Francisco 22 

- FO Syra:cu8e 20 
CM Denver ^ . 19 • 
Klng-Sboh(Hnlsh - 18 

Atlanta 18 * 

. Omaha 17 

Bergen 17 

Gulf ^Coast 12 . 



It Is clear that the range of variation Is neither wide nor Indicative 
of Important relationships between distribution of Jobs and nature of planning. 

The nature of the local population Is clearly a potentially Important. 
'Contextual factor. Concentration of disadvantaged Individuals In a prime sponsor- 
ship Is, unfortunately, a factor without a thoroughly reliable Indicator. 
Us«rof 1970 CensuB data must be reject^ because of the remoteness of the 
observations and the known forces that have modified both size and relative 
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conditions of populations since then. The local uneaploynent rate offers 
some approxissation of the nature of the local population that the^j^rograA must 
serve. Although haslcally unsatisfying, this substitute does, vhen high, 
suggctst that the sponsorship must serve both cyclically and structurally 
unemployed persons, and when lov, that it must respond to the dominant presence 
of the structurally unemployed. We. reference it to supplement our chief Indicator 
of the nature of the population as a factor In the general context. This y 
variable is the proportion of applicants at Employment Service offices who 
were economically disadvantaged far the period ending 9-77, as reported through 
the ESAKS system. This indicator does have the shortcoming of not estimating 
the incidence of the characteristic for all persons in the Jurisdiction, but 
does estimate it for a significant' portion of the universe of need. Data 
were missing for four sites (Atlanta, Gulf Coast, Heartland, and Denver). 
Those for the othet eight are reported on Table 3. 

« 

The size of the program la, clearly an element of the. general context because 
it is determined by a formula that is beyond the influence of local staff. 
(We consider such optional programs as YIEPP and STIP -separately in a later 
section.) Choosing FY 1978 Title I allocations as the indicator of size, » 
and representing these in millions of dollars, we note that sites ranged in 
size from very large to very small, and that sites in any particular model of 
planning are not characterized by their size. 



12 STUDY SITES. ORDERED BY SIZE OF 
FY 1*978 Title I ALLOCATION (in millions of $) 



FO 


Baltimore 


15.22 




King-Snohonlsh 


, 12.10 




San Francisco 


7.77 




Bergen County 


5.61 




Atlanta 


5.26 


CM 


Denv^ 


3.68 




Omaha 


3.26 




Heartland 


3.19 




Albuquerque 


3.06 




Gulf Coast 


2.17 


FO 


Syracuse 


1.66 


FO 


Penobscot 


1.33 
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Organizational characteristics may be ioportartt^n both the general context 
and in management decisions as context. Two elements that, because they are 
beyond the power of staff to Influence in the short run, are elements of the 
general context are 1) whether the sponsorship la a member of a consortium, 
and 2) its organizational location. Type of sponsorship has potential Importance 
because of the complications Introduced in a consortium by the presence of 
extra actors and priorities. Type of organizational location liiay become 
important to the extent that the parent body imposes constraints on- the operation 
of the CETA program. Organizations outside city government, for example, 
frequently are free from constraints imposed on sponsors located within govern- 
mental structures. These latter often must abide by civil service requirements, 
purchasing procedures, and the involvement of city councils or other ""elected 
officials. *Two tables are therefore presented to summarize the status of each 
sponsorship on these dimensions. * , I 




12 STUDY SITES BY TYPE OF 
SBONSOILSHIP (FY 1978) 



CONSORTIA 



SINGLE UNIT 



Albuquerque 
FO Baltimore 

Gulf Coa9t* 

Heartland . 

King-SnohoiBl^ 

Onaha 
FO Penobscot* 



Atlanta 

Bergea County 
CM Denver*** 

San Franclaco 
FO Syracuse 



* Split from Balance of State Sponsorship after FY 1975. 
*** Consortium dissolved after FT 1975. 



(HlGANIZAIlQfilAL LOCAIIGN OF ADHTNISTRAIIVE 
UNITS OF 12 STUDY SITES IN FY 1978 



City or County Office 



Albuquerque 

Atlanta 
FO Baltimore 
CM Denver 

Heartland 

Omaha 

San Francisco 
FO Syracuse 



FO 



Ccmsortium 
Executive Board 

Gulf Coast 
King«^Snohomish 
Penobscot 



Cofflaunlty 
Action Program 

Bergen County 



It Is apparent that status as a Future Oriented. or Operations Hanagement 
site Is not strongly associated with consortium membership. Likewise, the 
organizational locatlox^ of a sponsorship has not displayed dear relationship to 
the type of planning conducted at the site. 

General Context — Effects 

Table 3 arrays the factors of the general context by site, and clusters 
sites by models of planning. The most Important conclusion that emerges from 
Inspection of this table Is that to the extent that the identified variables 
accurately siromiarlze the important elements of the general context that might 
affect the nature of planning, these effects are .minimal . An almost random 
pattern characterizes the distribution of these el^ients In the twelve sites, 
with one exception. All three Future Oriented sites received low ratings on ' 
the measure of economic growth. All three were lower than all other sites except 
for Bergen County. This pujszllng pattern suggests that a relationship exists 
between low growth and the nature of .planning. Such relationship might exist 
If local concern over limited growth stimulated active responses from CETA 
and other local programs, responses not called forth In other sites more comfor- 
table with their growti^ rates. Interviews at one site Inconclusively supported 



Table 3: A SUMMARY OF THE RELATION OF. GENERAL CONTEXT 
TO THE NATURE OF PLANNING, SYSTEMS 



• * • 


1. Unemp* 
Rate 


2. X 

Growth 


3. Z 

^Service 
Jobs 


4. % 
Econ. 
plsadv. 


5. Size 
(million $) 

=— 


6. Type 
Ocons. 
S»slngle 
unit 


7. Org. Log. 
G"govt. 
B"board 
N-non-prof It 


/Future Oriented 






« 










Baltimore 


7.9 


7 


22 


40 


15.22 


C 


6 


Penobscot 


7.8 


MD 


MD 


36 


1.33 


. C 


B ' 


Syracuse 


9.4 


8 


20 


31 


1.66 


S 


G 


Operations Management 
















Albuquerque 


•8.3 


43 


24 


54 


3.06 


C 


G 


Atlanta 


10.7 


20 


18 


MD 


5.26 


S 


G 


Bergen 


8.6 

• 


0 


17 


13 


5.61 


S 


N 


Gulf Coast 


4.3 


45 ' 


12 


MD 


2.17 


C 


B 


Heartland 


. 9.4 


MD 


MD 


MD 


3.19 


C 


G 


Klng-Snohomish 


9.0 


16 


18 


41 


12.10 


C 


B 


Omaha 


6.4 


16 


17 


' 42 


3.26 


C 


6 


San Francisco 
Crisis Management 


ia.7 

* 


10 


22 


58 


7.77 


s 


G 


Denver 


7.4 


30 


19 


MD 


3.68 


s 


G 
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this posalbUlt^. Hof«rever» In the absence of strcnger evidence the pattern 
mist be slBiply noted as an exception to ^e dominant finding that none of the 
models ^« strongly associated with a pattern of variables In the general 
context. We note that Operations Hanagment slt^a cover the r^nge of 
un^eiplo3^ent rates , Include high and loi^ growth sites, are not necessarily 
large or saall, may be In a consortium but are not alvays, occur. In 
populations that vary In degree of economic disadvantage » and have varying 
organizational locations « We are cautious of making Inferences about the 
association of the Crisis Management model with factors In the general . • 

ccmtext because only one site provides observations and these do not 
conclusively establish a pattern.^ We do observe, however^ that the characteristics 
of Denver are not distinguishable from those of the eight C^eratlons Management 
sites » 

Management Decisions as Context— Elements 

We next examine the Importance of another aspect of context, that of the 
effect of general management decisions on the shape and nature of planning. 
Four Important groups of Indicators were selected. The first provides an 
estimate of the Importance of staff In shaping the natlire of planning by 
considering two variables^ the quality of key, staff and the prcysence of dlscon^ 
tlnultles In key staff tenure. The second takes Into consideration the nature 
of relations between the staff and other actors. Important groups considered 
are, political officials, servlce^Ndellvery contractors, advisory councils, and ^ 
business repres^tatlves. The thl^d considers some measures of the nature of 
data obtained for use In decisions^ centering on the quality and extent* of 
monitoring and evaluation Information. Finally^ we assess the extent to which 
optional progragm activity has Influenced the nature of planning. 

The ability of staff may be among the most Important of all contextual 
variables. Howevet, It Is a difficult matter to measure or even assign to 
ncmdnal categories. Two approaches were used In recognition of this. First, . 
field teams estimated average quality of key s.taff on the basis of observations 
and the Judgments of Interviewees. Second, turnover In key staff was tabulated* 
The results of the assessment In no case led to a site receiving loirer than a 
medlumh-hlgh judgment on quality of key staff. Those sites receiving high ratings 
were; * 

i Future Oriented 

Baltimore * 
^ Penobscot 

Syracuse 

Operations Management 
Bergeir County 
Omaha 

San Francisco 

This classification Is applied with caution, not only because of the 
estimation probl^, but also because of questions possible about causation: 
did a good site highlight the abilities of staff and did a difficult slt^ 
tend to obscure them? The second Issue, It can be noted. Is partially can- 
celled by utilization of the Judgments of on-site observers. 

\ 

Discontinuities seen^ highly Important In the Judgment of our site teams. % 
The sole Crisis Management site* (Denver) had experienced no less than f our 
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different directors during Its life^as well as tauch change at lower staff levels. 
Klng-Snohomlsh likevlae had suffered major disruption from change in administration » 
director, and upper level staff » and was the Operations Management site, that 
displayed some characteristics resembling those of Crisis Managanent. 
Albuquerque, however, had changed directors with less disruption. 

The second major group of management variables covers the nature of the 
relations of staff mesibers with other actors. Actor types most conaonly having 
influence on planning decisions in our twelve sites were staff menders, 
political officials » service deliverers, and advisory council members « The 
patterns in which these actors participated in planning decisions were 
tabulated by a^sesping the influence of each actor type on each of four decision 
areas (target groups, target occupations, program mix, service deliverer 
selection) at each site. Sepai^ating actors with high and medium Influenoe 
and sumaing the nti^er of decision areas on vhich they had high or medium 
Influence results in an approximation of the influence pattern. The. findings 
are judged to represent adequately the approximate relative influence exerted 
by service delivery contractors and advisory council m^nbers. They do not. 



^ NUMBER OF DECISION AREAS IN WHICH ACTOR^HAD 
HIGH OR MEDIUM PARTICIPATION 1/ 

Political . Staff Service Advisory 

Officials Members Deliverers Council 



Future Oriented 

Baltimore ' \ — 4 1 1/ 

Penobscot — 4 -~ 1 

Syracuse . ~ 4 — 3 

Operations Management * 

Albuquerque ~ 4 4 3 

Atlanta 1 ^ 4 4 3 

BSrgen — 4 3 a 3 

Gulf Coast 14 3 

Heartland 2 4 1 3 

King-Snohomish — 3 4 3 

Omaha — 4 

Francisco 14 4 3 



Crisis Management 
Denver 



1^/ Maximum score is 4 if actor had influence on target group, tatget 
occupation, program mix, and service deliverer decisions Local 
goal decision was not included in .thft analysis because it typically 
is made by staff only. 

2^/ Labor Market Advisory Councils were, however, important participants 
in Baltimore decision making. 



25 



iO 



however assets the participation of business representatives In decision 
making because these actors do not. participate In the same fashion as the 
others do. The auaoary table Is also judged to capture inadequately the 
importance of political officials bec'ause the influence of these actors may 
be more often exerted through anticipatory decision making by ^t^f than by . 
direct participation of the elected officials. Thus the table musit be 
supplemented vlth further measures for these actors. s 

Business InvolvCTent was the subject of specific Inquiry by our field 
teams; Who sought to determine which sites vent beyond nominal appointanent of 
business representatives to the advisory council and Involved the private 
sector in either program operations or program planning. Those that were 
judged to have high business Involv^ent were the three Future Oriented sites: 
Baltimore) Penobscot t and Syracuse. . Omaha and penver were judged to have medium 
involvement, chiefly because their programs Included prlvate-for profit 
service df^liveirers. The others' had either minimal ties or no direct ties. 

As mentioned, the influence of political officials on Title I decisions 
is underesiSmated when only their direct participation in decision m^ddng la 
measured. ^In Atlanta, for example, the Mayor intervened in these decisions — 
according to those we' interviewed'^-^nly three times since ^Title^ I began., u 
To assume because his -p^ticipation was in this sense limited that his ^ 
influence was also jLlmited^ would be to ignore that staff members make their 
decisions with awareness of the Mayor *s needs and interests. They anticipate 
the Hayoir's priorities and thus spare him the necessity gf directly Intervening. 
Partially as a consequence, they also enjoy his support for their decisions. / 
Conversely, the lack of such political support tiiay be expected to Inhibit att^pts 
by staff members to challenge the status quo^ It is therefore appropriate. tp 
estimate which sites had direct .access to their political superiors In w^s 
that suggested the presence of higher than average political support for the 
Title I program. The following observations were reported by field teams: 



Albuquerque — Current Mayor formerly 'directed Conprehensive 
Atlanta — 



l^anpower Program. 



Mayor active as spokesperson for the disadvantaged, 
and in U.S. Conference ^f Mayors. CETA director 
*^ active in Mayor *8 campaign while on leave of absence 

from program. 

' . • ^ 
Baltimore Mayor strongly supported positions taken by staff. 



Denver — 

Heartland — 
Omaha~- 

Penobscot — 

Syracuse- 



Former CETA director is now special assistant to 
Mayor for economic development programs. (He ^eft 
to go into private law practice at the end of 1978.) 

County Conoissioner vei:y active in CETA decisions. 

CETA directoi^ was temporary head of Omaha Office of 
Management and Budget.* 

County Commissioners strongly* support CETA Executive 
Director. 

Hayor formerly president of U.S. Conference of Mayors 
and very supportive of local CETA efforts. 
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In our sujanary table (Table 4) we have Indicated the presenct of greater 
than average political support with a positive (+) sign and. the presence of 
only average levels with a neutral (0) sign. We note that our present 
findings 'support our earlier findings (Ripley and Associates. 1977) that 
political officials tend to be jmch more involved In PSE than In Title I 
decisions. Although our present analysis does not assess Po^^^^^^^ ^"^^'t!:^ 
Interest In PSE decisions, it does deiaonstrate their infrequent Pai^titlpatlon 
in Title I decisions, relative to other actors. We would, however, modify the 
finding of the earlier study that most officials believe the CETA programs 
caimot benefit them but may be potentially damaging and. that they therefore 
encourage staff to function Independently only so long as they do not foster 
any noticeable controversy by noting that in all of the Future Oriented ^Ites 
and in some of the Operations Management sites, political officials have been willing 
to accept some controversy as the price of progress from the status quo to a 
more desired state. 

• ♦ 

Many different kinds of data were used In planning by the prime sponsprs , 
we observed. To dome extent, the use of data was associated with^the ability 
of staff to dig it out. and is therefore represented by the variable estimating 
quaUty of stJf . This tends to be especially true of "soft" data, those that 
are obtained by feedback through unofficial channels. There is In addition one 
kind of data that we feel to be essential to making Informed planning decisions 
an^ that is available only "if a management decision has devoted resources to 
statherinR it: monitoring data. We therefore determined the extent to which 
f^es weL aMe to collect these data, and the quality of the information they 
gathered. The results are included In Table 4. We also assessed the extent 
and quality of evaluations in like manner, but do not include that analysis 
because it demonstrated that most sites attach far less importance to 
evaluation than to monitoring. , 

Optional program activity, the final management decision we considered as 
a possible contextual variable, was defined as successful competition l>y^ P^^\ 
sponsorship for one of the grants awarded by DOL on other than ^^^^^^^^^^^^^^^^ 
Basis. We' considered three possibilities because of the substantial work 
involved In preparing the applications and administering the grants, and 
WailrtW ve?e current /t%he time of our study :^ STIP. YIEPP ^ler I, and , 
YIEPP Tier II Oxiv Interest was in both the possible direct effect of the grant 
in overloading staff with work arid perhaps more Importantly In the grants as 
representative of the general tendency of the sponsorship to undertake _ 
optional activity and devote sufficient resources to the effort to bring about 
success. Our appropriately coded findings are reported in Table 4. It la 

. noted that some YIEPP Tier grants are enormous-over twice tjie size of the 
sponsorship's Title I allocation in Denver-and therefore likely to have ^ 

. Important Impact. 

Management Decisions as Context — Effects 

Table 4 summarizes our findings for the variables we have discussed and 
organizes them by .planning model and site. The peneral conclusion supported by 
this table is that strong associations do e xist between the outcome of manafie- 
rn^r^t dftclstons made by the prime sponso r and the nature of planning. More 
specif ically. the Future Oriented slte^ a re distinguished by a set of particular 
^aSations oi Se 4ght indicators considered. Future Oriented sites In this 
I^pU InvarUlr ha^e excellent key' staff while only 3 of 9 Operations Manage- 
»rt were judged to have excellent staff. No discontinuities in key staff 
or administration existed^ among FO sites. Influence structures f^^^^^J^^^ 
sLf f dominated with only minor service deliverer participation in determination 
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Table 4 : . A SUMMARY OF THE RELATION OF MANAGEMENT DECISION VARIABLES 

TO THE NATURE OF PLYING SYSTEMS 





'1. 
Quality 
of Key 

Staff 


2. 

Discontinuity 
in Key Staff 
or 

Admlnis trat ion 


3. 

Service 
Delivarer 
Participation 


4. 

Advisory 
Conaalttee 
Participation 


5. 

Involvement 
of 

Business 


6. 

Political 
Official 
Support 


7. 

Extent/ 
Quality 
of 

Monitoring 


' 8. 
Optional 
Activity 


FUTURE ORIENTED 
Baltimore 


H 


N 


1 


* 


H 


+ 


H/H 


S/YI 


Penobscot 


K H 


N • 


— 


1 


H 


+ 


H/H 


S 


Syracuse 


H 


•N 


— : 


3 


H 


+ 


H/H 




OPERATIONS MANAGEMENT 
Albuquerque 


Nn 


Y 


4 


3 




+ 


H/M 


S/YI I 


Atlanta 


MH 


N 


4 


3 


L 


+ 


fl/MH 


S 


Bergen 


H 


N 


3 


3 


L 


0 


H/H 


S 


Gulf Coafit 


MH 


N 


3 


\ 




0 


ML/M 




- Heartland 


MH 


N 


1 






+ 


ML/ML 




King- Snohomish 


MH 


Y 


4 


3 


L 


0 


H/M 


YI 


Omaha 


H 


N 






M 


+ 


H/H 




San Francisco 

i 


H 


N 


4 


- 3 


L 


0 


H/H 


S 


CRISIS MANAGEMENT 
Denver 


MH 


Y 


4 


1 


M 


+ 


L/L 


S/Yl 


KEY: 


H-Hi . 
M-Med 
L-Lo 
—None V 


Y-Dlscon. 
N-Contln. 


/V ^ 

if-#of Decision 
Areas Actor 
Influenced 


H-Hl 
M-Med 
L-Lo 
— -None 


Above 
Average 
0-Average 


H-Hl 
M-Med 
I^Lo 
— -None 


S-STIP i 

Yi-yiEPP ' 

Tier I 
YII-YIEPP 



Tier II 



of planning dedslcms. (Advisory Counciis jpay or nay not be Important.) The 
three FO sites have achieved business invoiXrement to greater degrees than the 
CM sites. Above average political support is probably present. Monitoring 
is uniformly hl^ In both extent and quality. Finally, the FO sites display 
a cosmon tendency to seek and win optional grants that compleaient the activities 
they support under their formula allocations^ 

Operations snd Crisis Hanagement sites, in contrast, shared significant 
Influence with service deliverers in 7 of 9 cases. Three were handicapped by 
discontinuities In key staff. In two cases severely. Few sought the 
Involvement of business. Political support above average levels was probably^ 
present In only 4 of 9 cases. A majority did, however, win optional grant 
competitions, for the large Tier I YIEPP program in two cases. Only 3 of the 
9 possessed monitoring systems that we judged high In both extent and quality 
of the monitoring. 

Thus, although no contextual factor emanating from management decisions 
was unique to the Future Oriented sites, the pattern of staff -dominated 
Influence structure, high quality staff, stronger than average political support, 
thorough monitoring, and active involvement of business was characteristic. 

We are hesitant In' offering observations on the differences that 
characterize the Crisis Management 4odel because only Denver fell into It, 
thus precluding observation of patterns. We do note that Denver had an 
unsettled* influence structure in which service, deliverers are very Important 
and staff is much less Important than average. Denver has also experienced 
major discontinuity In key staff positions and is attempting to cope with high 
levels of optional program activity . Political support, although present, has 
tended* to constrain rather than facilitate. Staff quality is not uniformly 
high. Monitoring is very weak. On the basis of these observations, we hypothesi 
that the Crisis Management model may be associated with contextual factors 
emanating from management decisions as strongly as is the Future Oriented 
model. Naturally, the content of the relationship is reversed. However, this 
point should not be regarded as established giyen our limited data base. 

An Interesting anomaly Is offered by the presence of Omaha In the Operations 
^lanagement model although its ratings on the Individual variables are—with 
the exception of the optional program activity category—In the, pattern of the 
Future Oriented sites. However, the departure of large meatpacking firms from , 
the Omaha area may be a unique local problem that — ^because it has reordered 
the local economy from an Industrial to a service-baaed one — ^has absorbed the 

sSttentlon of program staff* 

•» 

The Effects of Context — Summary 

We initially posed the question of how context affects ^the nature of 
planning. We next separately assessed two basic types of context: the general 
context and the context formed by management decisions. We found that the 
general context la not strongly associated with the type of planning model, 
but that the context created by management decisions is so associated. This 
is particularly significant because the majority of the management decisions 
we have examined are manipulable . We hasten to add the recognition that such 
manipulation can be extremely difficult and require major efforts. But it 
may be possible if those who desire it are willing to pay the price that may be 
required. We further recognize that a site attempting to convert constraining 
patterns among the management decisions to favorable ones may be handicapped 
to the extent that it must devise a number of responses at once. The more 
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constraining factors the staff must respond to, the less likely it is, that 
each response will he successful Because of limits on staff accompll8hm.ents 
simply Imposed hy available tdbae. Likewise, the greater the nuaiber of 
constraining contextual factors present at a site, the greater is the 
l ike lih o od that a response designed to counter one constraining feature wd^ll be 
crippled ,by another contextual factor and fail to have the desired result. 
For example* an SFP system designed in one of our sites to respond to a 
stressful serv^C^ deliverer environment failed in part because staff 
discontinuities, another contextual feature, led to a non-functional MIS ^ 
system, a third contextual feature, the lack of \«hich doomed the BFP effort 
and left planning decisions essentially beyond control. (Other factors were 
also Important*) Finding a starting point to escape a counter-productive 
pattern may be Indeed difficult. 

On the positive side, we observe that although difficulties exist, they 
are not Insurmountable. The key elements we have identified that characterize 
the. Future Oriented sites are straightforward: 

— Key staff of the highest quality, who are encouraged tc raaain 
with the program and offer it consistent leadership. 

— Monitoring systems that yield accurate and complete information 
about the program. 

— Control of service deliverer participation In key decisions that 
affect the program serves and how It serves thesis 

— Deliberate steps to Involve the business conmunlty In more than 
token activities. ^ 

— A willingness to look beyond the narrow boundaries of operating 
programs^ allocated by formula (Indicated by the presence of optional 
program activity). 

— Political officials who support decisions made by staff and are 
willing to accept limited controversy when It Is the price of progress. 

With the -exception of the last two points, procedures to develop strengths 
In these areas either exist or are being developed. Management literature offers 
methods to recruit, train, and motivate staff. It also provides procedures 
for developing and using monitoring systems. The experience of many prime 
sponsors la available as a guide In controlling service deliverer participation 
without loss of the employment and training knowledge these deliverers have 
accmmlated. Use of non-voting service deliverer groups auxiliary to the 
advisory council, of RFPs and RFQs, of fair and open decision-making rules 
centered on objective data, and — Infrequently — of direct prime sponsor operation 
of programs are all examples. Business lnvolvement-«-once rare — Is the current 
focus of experimentation under Title VII of the 1978 CETA i^endments. Although 
this experiment may yield limited success If economic conditions deteriorate, even 
these limited successes will represent considerable Improvement over present 
low activity levels. Even a willingness to Innovate and the support of 
political officials, although more subtle In origin than the other elements, are, 
by the evidence of our sites, within the abilities of a reasonably advantaged 
prime sponsorship. The combination of all these factors appears associated with 
a distinctive type of planning. Whether these factors aire also associated with 
program performance Is the 'question we will examine next. 



III. EXPLAINING PROGRAM PERF(»tMANCE 



A. OVERVIEIf 

Many factors in addition to ttie nature of planning will affect prime 
sponsors^ program performance. While that la a siisple statement » eyen an 
obvious one, it quickly becoioes mired in complexity when the range of factors 
that may Impinge on program performance is enimierated. Prime sponsor staff 
a^inister local manpower programs in complex and diverse local environments 
or pontexts that include economic conditions, d^ographic characteristics, 
political conditions, previous program history, Departmcjnt of Labor guidelines, 
and attitudes and preferences of relevant actors. In addition to contextual 
features such as these, characteristics of the staff's own organization apd 
its management decisions often have an impact on performance (manpower planning 
activities and decisions are considered as a subset of staff management 
characteristics or decisions) « Characteristics of the manpower delivery 
system in operation, and the ability to Implement planning decisions can 
obviously' also have an effect on program performance. Mding to the overall 
difficulty in imderetanding what affects program performance is the ambiguity 
of the^ nature of program performance itself. It may be thought of in terms 
of short-term outcomes like placement rates, wage gain after CETA participation, 
and cost efficiency measures. It may be more appropriately measured In terms 
of long range economic impacts on former CEIA participants. And performance 
can also be measured in terms of administrative and process oriented features 
such as degree of participation in decision-making by non-staff actors. 

Figure 2 presents a diagram to help visualize the various relationships 
that are possible between performance factors and antecedent conditions. T^is 
diagram will be used to organize the present Investigation into expla^ng 
'program performance. The shading of sections for context, management ,Tnd 
planning Indicates tha^ all of these areas affect performance. 

In Section 11, we examined associations between selected features 
of local context ^d planning models, as well as linkages between management 
characteristics ^tad planning, to help explain under what conditions different 
types of plannidig would emerge. , ^ 

In the presenF Section, we want to %temine the linkage between planning 
and performance^ But because performance can be affected by many factors other 
than planning, we want to look at the linkages between features of context and 
performance, as well as associations between management characteristics and 
performance. We will examine again some findings about the Impact of program 
mix and participant characteristics on performance reported in earlier 
research (see, for example, Ripley and Associates, 1978: chapters A & 5; 
Mirengoff and Rindler, 1978: chapter 9). We are also interested in\testing 
the validity of certain operating assumptions (conventional wisdom) of 
manpower practitioners. The analysis in this section will foctis on describing 
and explaining the linkages/ound for the 12 prime sponsorships included in the 
areawide planning study, y^fhere appropriate, we will also compare our findings 
about the 12 planning sftes with the situation in the 30 other prime sponsorships 
in which we conducted ftteld work for two pi?evlous' studies. 
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Figure 2: PROGRAM PERFORHANCE AND ANTECEDENT CONDITIONS 

KjO 48 ^ 



Dlacusslon of PerfbinaaBCe Measurea 



Unfortunately, there la no alngle sumniary measure of prime sponsor 
perform^ce that would allov a researcher or evaluator to classify prime sponsors 
into groups of good or bad, worst or best performers. Such a susmary classl- 
flcatlon would be too sliBpl£stlc anyway, becaude •''performance" Is a concept 
with many dimensions, l^erformance measures can Include placement rates, quality 
of placements, participants* wage gain In the short run, wage gain in the long 
run, economic Impact of CETA on the local coiomunlty, management efficiency 
of the prime sponsors* administration, cost efficiency of manpow^ programs, 
local prime sponsor perceptions about success in achieving local goals, and 
many more. All of these are legitimate aspects. of performance, but there are 
not equally Important, and furthermore, data are not equally available to 
measure each aspect of performance. 

The impact of CETA partlclpati9n on the future employment, earnings and 
career advances of participants — impact that is categorized long range 
program outcomes in Figure 2— is, or at least should her the ultimate measure 
of prime Sponsor performance. Improvement in the econcmlc situation of CETA 
participants — increased earned income — is a major purpose of the CETA program, 
as Section 2 of the 1978 amendments to the CETA^eglslatlon clearly indicate. 
Ideally, If success is to be judged in terms of economic impact on the 
participant, data should be available to measure not Jus t^ whether a person 
was placed after CETA, but also 'to measure long-run economic consequences such 
as retention in employment, wage gain over time, and client satisfaction with 
CETA services. The only* source of such data, however, is the Continuous 
X&ngltudlnal Hanpower Study (CI2fS) funded by the Eoaployment and Training 
Administration, but its findings based on followups of a nationwide sample of 
participants are Just beginning to emerge (see Vestat, 1978). 

Prime sponsors have not been required to collect systematic data on the 
post'-CETA experlencQH of participants. Followup on participants at l^e prime 
sponsor level is almost totaily absent. This results in a lack of knowledge 
about quality of placements, type of occupations, long range wage change of 
participants, and moves up (or down) career ladders. A few prime sponsors do 
conduct this type of impact evaluation on their own, but most do not. The 
federal quarterly report forms do not contain space—freto prime sponsors to 
report on participants* post-CETA experiences even as an optional item. 

Thus even though long term economic outcomes on participants may be 
recognized abstractly as the most desirable way to measure prime sponsor 
performance, data are not available to allow comparisons and Judgments about 
prime sponsors to be made. 

The existing data collection systoa established by the Department of 
Labor stresses only selected short run quantitative mea£Kires of performance 
such'^s ntmiber of participants enrolled, placements obtained, and nonpositive 
terminations for all prcTgram activities within a jingle title. Information 
on participant termination experiences by individual program activity (classroom 
training, OJT, work experience) is not included, however, and comparisons of the 
effectiveness of different types of program strategies therefore cannot be made. 
A few prime sponsors do produce comparative information at thelx; own initiative. 
Most do not because it is not required by the Department of Labor. And even 
those that do collect such data cannot report it to DOL because the quarterly 
report forms do not contain space for such optional information* 
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In short, the existing data on prise sponsor perfoxmance capture only a 
Halted diaenslcm o£ performance, and permit only rudlmentaxy judgments to be 
made. As Mlrengoff and Rlndler note (1978:222-^223) : the present data 

system. ..has gaps in essential data, a lack of flexibility for making 
crosstabulatlons, and poor quality control." 

In this report', we can note the shortcomings of the data available from 
quarterly reports, but «e mist use It anyway because they are available, and 
because they reflect the main goal of the Department of Labor for CETA Title I 
durlnig Its first four years, namely placements. Discussion of the short term 
program performance measures used in this analysis follows. 

~^ ' * . * 

How effective Is partldpatlcm In CBIA in terms of getting people Into an 
unsubsldlzed job? The overall placcaaent rate (abbreviated PUIATE) Indicates 
what proportion of the total participants enrolled succeeded In obtaining 
unsubsldlzed employment. It Is cooputed by dividing the number entering 
employment by the nuniber enrolled for each quarter. 

■« 

Because the number' of people who enter employment Is comprised 'K}f self- 
pla<^ent8 and direct placements (persons who received just outreach. Intake, 
manlier services and perhaps supportive services) as well as Indirect placements 
(people who receive training and employment experience as well as outreach. 
Intake, manpower servlceOnd perhaps supportive services). It' Is useful to 
Include an additional meaaurjei of placement that taps the effectiveness of the 
real essence of CETA services (the training and employment experience) In - 
getting participants a Job. The nuiaber of Indirect placements divided by the 
total number of partldpantc enrolled provides one plausible measure of CETA*s 
placement efficiency (abbreviated FL^TIC) , and Indicates what proportion of all 
the people enrolled got unsi&sldlzed employment after receiving CETA training or 
employment experience (that Is, CETA services other than Just outreach. Intake, 
or manpower services). 

The rate of nonposltlve terminations (abbreviated NPT) from Title I ^ 
Indicates the proportion of participants \Aio leave the CETA program for other 
than positive reasons (such as obtaining employment or returning to school or 
entering the military.) A high nonposltlve termination rate can Indicate 
problems In management of recruitment, assessment, and referral of enrollees, 
as well as problems In participant flow and placement activities. NPT is 
computed by dividing the number of nonposltlve terminations by the ntmber of all 
terminations for the quarter. 

The cost per enrollee ($ENROLL) and cost per placement ($FLCMT) provide 
two simple measures of the ecdnomlc effldracy of the operation of local CETA 
programa. The measures are computed by dividing the total accrued expenditures 
by the number of enrollees and the number of persons placed, respectively. 

We should explain the decision not to use one category of data that is 
Included In the quarterly reports submitted by prime sponsors. The Quarterly 
Summary of Participant Characteristics (QSPC) Includes reporting sections that 
compare the wages of participants placed In unsubsldlzed employm^t after CETA 
with the wages they earned before CETA. We chose not to use this information 
to' construct a wage gain measure for several reasons. Including serious doubts 
about the accuracy of the data reported, and lack of controls for the effect 
of Inflation over time, and the lack of a control for different prevailing 
•wage rates among prime sponsors. The most troublesome of these drawbacks was 
the concern over the quality of the data, however. Interviewees Indicated that 
the figures reported tended to be esttgiates at best, and that they also tended 
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to overstate the actual wages earned after placeaent. Verification of the 
reported figures Is not possible, either for prime sponsors or for researchers 
such as ourselves. Examination of the completed QSPC forms makes It clear that 
prime sponsors' MIS staff do not understand how to complete the pre- and post- 
CETA wages section ot the forms — numbers that are supposed to add up don t, 
and large nuu&ers of placements are unaccounted for. Given these problems, we 
reluctantly excluded wage change from our performance measures. 

• * 

The concfept of standardized performance measures for CETA was developed 
and articulated by the Department of Labor In FY 76. Many prime sponsors objected 
to the manner In which the performance measures were applied, arguing that local 
diversity of clients, programs, and economic -conditions rendered uniform 
national standards arbitrary and Inapplicable. We have not attempted to set 
arbitrary ranges xQ|^acceptable or unacceptable performance for the measures 
discussed above. We have some doubts about the validity of some of the 
performance measures and about the quality of data reported In some cases. 
However, we used these measures In a previous study with results that did no 
violence to more qualitative judgments (Ripley and Associates, 1978). We have 
also avoided overreUance on any single measure as a safeguard against making 
Invalid Inferences. 

Methodology 

» 

We relied on a, variety of techniques to describe and explain relationships 
among the explanatory and performance measures. We used simple descriptive 
statistics and contingency tables when the data categories were only nominal 
or when the nunber of data points (observations) was too small to permit any 
other kind of technique to be used. We used blvarlate correlational analysis 
to test for the strength of associations between pairs of variables* and we 
^ed step-wise multiple regressions to test for the effects of numerous 
explanatory variables on performance measures.* 

Many of the quantitative data used to measure explanatory factors (for 
example, unemployment rate, program expenditures, partlc^ant characteristics) 
were available from prime sponsors' quarterly reports to DOL (Quarterly Summary 
of Participant Characteristics, Program Status SuBBoary, and Financial Status 
Report). We used data from these reports for the quarters from DeciEaaber 1974 
through June 1978 (the most recent quarter for which data was available) . Many 
other explanatory factors that we Investigated were more qualitative In nature 
(for example, attitudes, prefer^ces, and Management characteristics of the 
prime sponsorship). For these more qualitative measures, the time points used 
in analysis were limited to those quarters during which field work was done, 
plus the quarters Immediately preceding and Iraaedlately following the on-site 
quarter. The reason for this restriction Is simply that we could not be 
confident that the aspects of prime sponsor characteristics captured in the 
qualitative measures would remain constant over time. (In fact, it is the 
nature of' these variables to change; we could >M»dge them for the period of 
time of on-site field research, but we did not feel comfortable extrapolating 
forward into the future or backward into the past for more than one quarter.) 
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* Correlation and multivariate analyses used the SPSS (Statistical Package for 
Social Scientists) programs, which are supported at the Instruction and 
Research Computer Center at Ohio State University. 
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B. RELATICaySHIPS BETWEES COKTm im PERFORMANCE 

In this section we examine the associations between selected parts of 
the prime sponsors* local context and the standard Indicators of performance. 
The strategy guiding the choice of context elements to be examined was based 
on a desire to re-examlnlEi previous research findings (Ripley and Associates, 
1978) using a different sample of prime sponsors as well as a desire to 
examine some of the connon assumptions ("conventional wisdom*') underlying 
manpower program operations. The availability of data of reasonable quality, 
accuracy, and comparability among prime sponsors also contributed to some of 
the decisions. In the follow^g pages, the lim^t of economic conditions^ 
demographic conditions, attitudes, and prevlo^ program decisions are 
examined, using both blvarlate and multivariate analyses. 

Blvarlate Relationships Between Economic Conditions and Performance 

" 

Pnenployment Rate * We used the local unesq;>loyt&ent rate to measure economic 
conditions not only because It Is a readily accessible measure, but also because 
It Is widely perceived to be the most important feature of local economies that 
constrains CETA performance. Monthly unemployment rate data from the * 
Bureau of Labor Statistics were averaged to obtain quarterly and annual averages 
of unemployment rate In the prime sponsorships. 

We wanted to examine the statistical association between unemployment 
rate and performance measures to determine whether and how much unemployment 
constrains good performance. If unemployment rate correlates strongly with 
performance measures, then manpower practitioners are correct in believing that 
unemployment rate will limit program choices and performance. If, however, 
there is no relationship or only a weak one, then local manpower practitioners 
would have greater latitude in making program choices and in managing program 
performance than they may realize. Specifically, the conventional wisdom that 
high unemployment u associated with low placement rates (and the converse, that 
low unemployment is q|g|pclated with high placement rates) would be seriously 
challenged, if no relatlx>n8hip or only a weak relationship were found. The 
results of an earlier CETA study did present such a challenge to conventional 
wisdom (see Ripley and associates, 1978:^2-85). ^ 

Using blvarlate correlational analysis we tested the association between 
unemployment rate and performance in a ntnober of ways* We correlated the 
quarterly unemployment rate with the cumulative performance measures for the 
same quarters . We also correlated quarterly unemployment with performance 
data that were lagged one and two quarters later, reasoning that the effects of 
unemployment may take some time to be observed in performance. We also correlated 
the annual unemployment rate (compute on a fiscal year basis, to be 
comparable with the performance data) with, just the cumulative end of fiscal 
year performance figures, reasoning that relationship between non-cumulative 
unemployment rates and cumulative performance data might not be apparent unless 
the annual average were used. For each test using different operatlonallzatlons 
of unemployment rate, we examined all quarters since December, 1974, together 
for the 12 planning sites ^ as well as separating out the end of fiscal year 
quarters and analyzing them separately. 

The general conclusion emerging from all of the tests of unemployment 
rate and performance measures is that there were no strong relationships. 
Table 5 presents the strongest correlations found — those between quarterly 
unemployment rate and program performance measures. The correlations between 
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annual and lagged unemployment rate, and performance measures were all weaker 
than those presenlted In Table 5, and for space reasoiis they are not presented in 
tabular form.* 

As Table 5 shows, the highest single correlation coefficient obtained 
was OTily .31 (between unemployment rate and nonposltlve termination rate) for 
the end of fiscal year quarters. When all quarters were analyzed together, 
the relationship was weaker (.25). This suggests there was some tendency, 
but not a strong one, In |^e 12 planning sites for higher unemployment to be 
associated with higher nonposltlve termination rates. 

% 

There was also a weak relationship present between quarterly unemployment 
rate and both measures of placement for the end of fiscal year quarters In the 
planning sites. The weak Inverse relationship (r*s - -.26 and -.27) suggests 
that there was a slight tendency for hlgl^ unemployment rates to be associated 
with lower placement rates. This supports the generally accepted belief about 
the effects of unemployment., but It should be noted that the relationships 
are very weak and ought not to be considered determinative. Certainly they do 
not justify ,an attitude that the prime, sponsor staff are helpless to Improve 
placement rates because of the level of unemployment rate. 

There were no correlations greater ^han the cutoff of .20 for either 
measure of cost efficiency, except for a weak inverse relations between 
quarterly unemplo3nnent rate ai^d cost per enroliee for the end of fiscal year 
quarters. This relationship means that there was a weak tendency for prime ' 
sponsorships with higher unemployment rates to have lower costs per enroliee. 

A possible exception to this generalization can occur in a ptime sponsor 
in which unemployment is rising rapidly, specifically in industries in which 
the prime sponsor has concentrated training and placements, in such a case, 
the Impact of unemployment on performance would be strong and direct. But 
that possible exception does not weaken the general finding that unemployment 
is only weakly associated with performance. ^ 

The weak to non-existent relationships found in this part of the analysis 
support the general assertion that program performance is not controlled by 
unemployment rates. The most that these results show is a weak inverse 
relationship between unemployment and placement and a modest positive - 
relationship between unemployment and nonposltlve terminations for the 12 
prime sponsorships in the planning study. 

We extended the bivariate analysis of unemployment rate to see whether 
changes In unemployment were related to changes in program mix measures in 
the 12 planning sites. We again found that unemployment rate was not strongly • 
related to program mix either in terms of enrollments^pr expenditures. ^There 
was a weak and unexpected relationship between higher proportions of OJT , 
expenditures and higher unemployment rates (r-.2A), which is not an association 
that conventional wisdom would predict. Practitioner belief is that OJT 
expenditures would decrease in times of higher unemployment. 



* In discussing correlation coefficients, we used the following guidelines 
throughout Section III: coefficients of less than .20 were not considered 
to be strong enough to represent a relationship; those between .20 and .30 
were described as representing a weak reiationship ; coefficients between .30 
and .50 describe a im>derately strong relationship, and those greater than .50 
represent a very strong relationship. * 
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Table 5: 



Blvarlate^rrelatlons 6etwa|n Quarterly Unemployment 
Ran and Performance Measures 



1 * 



«9 

* 


Overall 
Placement > 
Rate 


Placement 
Efficiency 


Non Positive 
Termination 
Rate 


Cost 
■ Per 
Enrpllee 


Cost 
Per 
Placement 


12 Planning Sites, All 
Quarters since 12/74 
(N-155) 

♦ 


.1/ 

> 




.27 




1/ 


12 Planning Sites, end 
of fiscal year quarters 
(N-45) 


-•26 


• 

-.27 


.31 


• 

-.24 


1/ 



-3 



1/ Correlation coefficient (Pearson R) less than .20. 



There was also a weak tendency for the proportion of work experience 
enrollments to be hlghfer In- prime aponsors with higher unemployment rates 
(none of the r'a was greater than .25), which is moreen keeping with expec- 
tations. The proportion of "other" enrollments showed a moderately strong 
tendency to be higher In prime Sponsors with higher unemployment (r«.40). 

^ore significant than the relationships found between unemployment rate 
and program mix measures, most of which were only weak, was the absence of 
strong relatlbnshlps between unemployment rate and the proportion of either 
expewdltures" or enrollments for training activities. The absence of strong 
correlations means that program conaaltments to classroom" training and OJT 
were not dictated by tinemployment rates in the 12 prime sponsors in the 
planning study. Changes in expenditures and enrollments were occurring 
Independently of changes in the unemployment rate. Unemployment rate was 
not a controlling factor determining the actual mix of program expenditures 
and' enrollments . 

Other Indicators of Economic Conditions. Although unemployment rate is 
generally accepted as a good measure of local economic conditions, we wanted' 
to use some additional measures of local economies to enlarge our investigation 
into the relationship between this context feature and program performance. 
Comparable labor market data were not available for two of the planning sites 
(Penobscot and Heartland) so they h^d to be excluded from this portion of 
the analysis. For the other ten sites, we obtained Information from the BLS 
Qnployment and Earnings reports on the proportion of workers in local labor 
market areas who were employed in service occupations. We felt there might 
be a relationship between the proportion of services in an area and the prime 
' sponsor's placement rates. Specifically we hypothesized that placements would 
be easier and therefore placem^t rates would be higher in economies with a large 
proportion of service occupations because jobs in the services classification 
are generally more accessible to CETA participants than are jobs in 
manufacturing in' which union memberships and Skills requlremeiiQs often pose 
significant barriers to employment of CETA participants. 

The results of correlations between the proportion of service workers 
and the placement rate measures showed that there was no relationship, 
however. The absence of a relationship is encouraging because it Indicates 
that prime sponsors* placement rates were not tied to the prevalence of 
service occupations in their area, but rather were diversified among other segments 
of the economy. * . * ^ i 

We also used BLS reports to derive a simple measure of economic growth In the 
planning sites, computing a ratio of the total number of workers in the labor 
market area In 1977 compared to the number of workers in 1970. Tha ratio ranged 
in value from 1.00 (indicating OX growth In the number of jobs) to 1.45 (indica- 
ting a very large A5Z increase in the number of Jobs). (Penobscot and Heartland 
data were again unavailable.) 

Practitioner wisdom suggests tWat plac6ment rates would be higher in 
prlm^ sponsors with high growth raj^s. If the number of jobs la increasing 
it is presumably easier to plaice people'. In areas with low or no growth, 
placements would presumably be more difficult. Our analysis, however, showed 
that growth in the economy is not a guarantee of good placement ratfes, nor is 
lack of growth a serious constraint to good placement performance. ^ 
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Three of tb^ priflie sponsorships with the lowest growth (Bergen had OZ, 
Baltimore had 7Z, and San Francisco had lOZ growth) In the number of Jobs 
between 1970 and 1977 had very high placement rates (the overall placement 
rate for fiscal 1978 and fiscal 1977 was averaged) « Nearly all of the prime 
sponsors with higher growth In their economies had placement rate figures 
that were lower than these three prime sponsors with, low growth. 

Of the two prime sponsorships with the highest growth rates (Albuquerque 
had a 43Z Increase and Gulf Coast had a 45Z Increase) , Albuquerque did show 
the highest overall placement rate of any of the ten prime sponsors analyased* 
Gulf Coasts despite an even higher growth rate, had a placement rate that 
was good but not outstanding; It was In fact lower than the overall placement 
rates achieved by the three prime sponsors with the least growth, and the same 
as the placement rate of the fourth prime sponsol: with low growth '(Syracuse), 

Other prime sponsors with high growth rates showed good placement rates, 
but not as sensational as one would e^qpect If the effect of growth on QETA 
placements were really the key to success* None of the other prime sponsors 
with higher growth achieved plac^ent rates as good as the placement rates of 
the prime sponsors with the least growth. 

Table 6 susamarlzes the data on growth In a number of jobs and prime sponsor 
placement rates. This table supports the general conclusion that while growth 
In the economy doesn't hurt placement rates'. It Is not an essential condition* 
Prime sponsors with low growth can still achieve very good placement rates — 
although they may have to work harder to do It with measures such as more 
conscientious planning, supervision of Job developers, and attention to 
occupational trends* 

Blvarlate Relationships. Between Demographic Characteristics and Performance 

We used characteristics of CETA enrollees as a surrogate measure of 
demographic features In the prime sponsorship* Earlier research has shown 
that the characteristics of CETA enrollees are reasonably representative 
of the universe of need in the prime spoii'sorshlp (Ripley and Associates, 
1978:54-^.55). 

An additional reason for Investigating demographic characteristics of 
participants is that conventional wisdom among manpower practitioners suggests 
that the type of participant served determines the level of program success* 
We wanted to test the presumed linkage between this element of context — which 
Is manlpulable by manpower staff throtigh the decisions and policies of Intake 
and recruitment agencies — and program performance. 'We also wanted to examine 
an earlier finding of almost no relationship between participant characteristics 
•and performance (Ripley and Associates, 1978:91-93), 

We examined both all enrollees and all participants placed, using a 
variety' of characteristics typifying persons more "difficult" to serve and 
place. These Included; percent economically disadvantaged, percent welfare 
recipients (AFD€ and public assistance), percent female, percent with less 
than a high school education or equivalent, percent who were unemployed at 
the time they entered CETA, percent nonwhlte, and percent youth (less than 
22 years old). Hie data came from the QSPCs. We examined the 12 sites In the 
planning study for all quarters except September 197A and also for Just the 
end of fiscal year quarters. * 
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Table 6: Growth In Number o£ Jobs in the Local Economy, 1970-^1977, 

and CETA Placement Rates 



Prime Sponsor 1/ 


Economic 
Growth 
1970-77 

= h- 


Overall 
Placement Bate 
(PLRATE) 2/ 








Bergen County 


OX 


40% 

< 


Baltimore Cart* 


72 


40% 


Syracuse 


8% 


38% 


San Francisco 


10% 


40% 


Omaha 


16% 


« 

V 36% 


KSMC . * ^ 


16% 


30% 


_ Atlanta 


20% 


32% 


Denver 


30% . 


35% 


Albuquerque 


A3% 


48% 


Gulf Coast 


45% 


38% 



V 



1/ Data not available for Penobscot and' Heartland Consortia. 

2/ Cumulative overall placement rates for fiscal 1977 and 1978 averaged 
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Table 7 presents the tesults o£ correlations betiieen participant 
, characteristics and performance f&easures. (Data are reported only for the 
.characteristics of all enrollees for end of fiscal year quarters.) The 
relationships between characteristics of participants placed and performance 
measures were much weaker (although none were contrary to those in Table 7), 
and for space reasons they are not included in the table* 

The results provide only limited support for the general notion that 
participant characteristics per, se^ d etermine program performance levels, 
or that certain types of people cause podrer performance. Many of the 
associations between client characteristics and performance measures were absent 
or were only weak. For example, the percent of economically disadvantaged was 
not associated with either placement or nonpositive termination, nor was the 
percent female. The percent of welfare recipients showed only a weak depressing 
effect on only one measure of placement. 

None of the client cHliracteristics were related to nonpositive terminations. 
Only the^ percent economically disadvantaged aad the percent of welfare 
recipients showed a relationship with cost per placement, and that was extremely 
weak. 

Some of the refsults of the bivariate analysis between client characteristics 
and performance measures do support the conventional expectations, however. 
For example, there was some association between the percent of nonwhite 
enrollees and poorer placement rates. The most notable relationships were between 
the proportion of young enrollees and placement and costs per enrollees « 
For example, both the percent of enrollees %Ako were less than 22 cmd the percent 
of enrollees who did not have a .high school education showed a distinct ajssociation 
with lower rates of placement, for both measures of placement (r*8 were in the 
-•40 to -.50 range). 'These characteristics were also related to cost per 
enrollee, though less strongly. There was no association between the youth 
measures and the cost per placement, however* (There was a high correlation 
between the percent less than 22 and the percent without a high school education, 
in the .9 range, suggesting strongly that bath variables are measuring the 
same group of people in the 12i' plaxming sites. This is logical j since many ot 
the young enrollee& in CETA^programs are high school students ^o have not -yet 
graduated.) . ^ ^ 

Based on the bivariate analysis of client characteristics and performance 
measures, we can conclude that except for the younger enrollee group, the 
demographic characteristics of participants have unimportant effect on prime 
sponsor program performance. This suggests that prime sponsor staff need^.not 
feel that the demographic composition of their participant group will predetermine 
the level of performance on placement, nonpositive termination, and cost effi- 
ciency measures. This also suggests that screening clients at intake and 
referral (skinning or creaming) is not necessarily going to result in better 
performance. ^ 

A caution in interpreting these res»ilts of bivariate relationships must 
be offered. We are not asserting on the basis of these statistics that there • 
is no difference among clients ^ and that the nature of participants has no 
bearing on program performance results. Indeed, we believe that CETA 
participants, like most people, vary in terms of the personal motivation, 
incentive, and the barriers to employment that they face. These types of 
qnaXltative characteristics can affect program performance, but they are 
not accurately measured by the demographic data reported on the QSPCs. Ip 
terms of demographic characteristics, we do assert that there Is little Impact 
on program performance other than for the yoimger participants. 
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Table 7: Bivarlate Rexatlonshlps Between Part±c±pant~^aracteri8tics and Performance 
Measures, 12 Prime Sponsors, for End of Fiscal Year Quarters i/ 





^LRATE 


PLEFFIC 


/ 


NPT 


$ENROLL 


$PLCKr 


X tcott. Disadv. 1 


2/ 


2/ 




( 

2/ . 


1 

.21 


.20 


!(l Welfare Recip. 1 


-.27 


2/ 




2/ 


2/ 


.21 


X Without High 
School Educ. 


-.40 


-.50 




2/ 


-.51 , 


2/ 


Z Female | 


2/ 


2/ 




2/ 


2/ 


2/ 


X UncBjployed 




2/ 




2/ 


*2/ 


2/ 


X Nonwhite 


-.26 


-.38 




2/ 


2/ 


2/ 


X Less than 
22 Years Old 


-.49 


-.48 




2/ 


-.26 


2/ 



^/ The number of cases is 45* 

2/ Correlation coefficient (Pearson r) ia less than .20. 
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Blvarlate Relationships Between Attitudes of Actors and Perforaance 

Tho attitudes were tested for their assoclatloii with performance measures-*-* ^' 
comaltment of the ataff to serving the economically disadvantaged and commitment 
of the staff to placement as a goal for Title I programs. 

Th® commitment to the economically disadvantaged Is an attltudlnal measure * 
reflecting tjike extent to which the management level staff articulated preferences 
for using Title I resources to help primarily economically disadvantaged 
participants (as opposed to other possible target groups). Judgments about' 
this attitude were made by our field staff following extensive field work In 
the sites, observations, review of documents, and lengthy Interviews. The » 
attitudes among the .12 planning sites iranged from very strong and explicit 
s preferences for serving the disadvantaged to moderate ^^ra^ltment. 

V In testing the association of this variable with performance measures, we 

did not attempt to reproduce exactly the research reported earlier (Ripley and 
Associates, 1978:66) between attitudes and characteristics of persons who 
were served, and the results of the present research are not as conclusive as 
those reported earlier. Seven of the planning sites were judged to have very strong 
and explicit comnltment to serving the economically disadvantaged with Title I 
resources. Four of those sites also performed best In terms of actually 
serving the economically disadvantaged. (Service to the economically dls-" 
^ advantaged was measured three ways : In terms of the percent of enrollees 
who were classified as econaalcally disadvantaged, the percent of all 
^ participants placed who^were similarly classified, and the proportion of * 
economically disadvantaged persons placed relative to the percent and 
proportion of . economically disadvantaged enrollees.) In these four sites, 
. the expectat^fon about attitudes and performance were confirmed. 

But Inr two of the seven prime sponsors where the sTaf f had very strong 
comnltment/ to serving the economically disadvantaged the rate of actual service 
to them \^ds lowest of the 12 prime sponsorships: the regaining "very strongly" 
coomltted prime sponsorships had relatively low performance. The one prime 
sponsor^lp where cosoaltment to the economically disadvantaged was Judged to 
be onW moderately strong nonetheless displayed the highest ra;te of actual 
servl^ to economically disadvantaged of any of the 12 planning prime sponsors. 
There/was no relationship apparent between the level of commitment and placement 
ratea' or cost measures. 

These results suggest that although a strongly held attitude on the part 
of the management level staf^ for serving the disadvantaged may be important to 
achieving high actual levels' of service in some cases, the attitude alone will 
not assure good performance* 

Another attitude examined was the staff's commitment to placement as a goal 
for Title I programs. The commitment to placement is an attltudlnal measure 
reflecting the extent to which placement was articulated and regarded as a goal 
for Title I programs by the management level staff of the prime sponsors. 
Judgments were made by our field staff following site visits, and ratings ranged 
from very strong and explicit commitment to placement to limited coimnitment. 

The analysis of the relationship between this attltudlnal variable and 
actual perfoirmance showed aotoB. relationships were present as expected, although 
not as dramatically strong as were expected. Correlations between the ratings 
on this variable and performance measures (using only on-site quarters) showed 
that there was a weak association between level of comnltment to placement and 
overall placement rate (PIRATE r-.22) which suggests that in prime sponsors 
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Where tronDltstent^as highest, there was a weak tendency for t>lace]aent rate to 
also he high. There was no association hetween this coiamltment measure and 
the Indirect placement measure, however. 

There was a reasonably strong inverse relationship between the stronger 
commitments and the rate of nonposltive terminations (r"-.42), Indicating that 
in prime sponsors with stronger comnltment to placements, the nonposltive 
-termination rate was distinctly lower. There was no relationship found between 
the conmltment to placement and either of the cost measures. 

The relationship between strength of conoltment to placement and actual 
placement rates was not strong, but this finding is not illogical. A staff 
conmltment will not by Itself guarantee placement success, but the presence 
of such a comnltment will be likely to facilitate other actions that 
can directly affect placement, for example, monitoring and coordinating job 
development activities of subcontractors, or changing training curricula as 
occupational trends in the labor market area change. 

This investigation between attitudes and performance has not been 
comprehensive, but it has revealed a modest association between attitudes 
and performance liji the 12 planning sites. We would conclude from this 
exploration that- while the attitudes oC, actors do not pose unsurmoun table 
constraints on performance, neither does the presence of felicitoiis attitudes 
guarantee good performance. Attitudes can affect performance Indirectly, 
and other factors besides attitudes In the 12 planning sites studied offered 
greater explanation of variation In performance. 

Bivarlate Relationships Between Previous Program Operations and Perfornaage 

We treated program mix as an indicator suggestive of previous program 
operations. We were less Interested in the constraints that previous decisions 
about program mix pose for subsequent years* program mix decisions (the so-called 
"incremen talis t" argument) than we were in the effects that program mix 
connltments have on program performance. Practitioner wisdom suggests that 
training programs, although they are more costly, result in better placement 
rates than do work jcxperience or PSE. Program mix is a vkrlable tliat is 
moderately manipulable by manpow^^taf f . 

The best test of the relative effects on program mix decisions on performance 
would be to examine the placement rates and cost measures associated with each 
program category — classroom training, OJT, and so on — and compare them. 
. Unfortunately, such data are not available, and the best substitute available 
' is to relate enrollments and expenditures for each program component with the 
ptlme sponsor's overall placercnt rates and cost measures. 

W^ measured program mix enrollments by dividing the cumulative number of 
participants In classroom training, OJT, work experience, PSE, and other 
activities by the cumulative number of total enrollees for each quarter. 
("Other" was not a reporting category after FY 76 j participants in the governor's 
5Z vocational education category were not included.) The percent of prograif 
mix expenditures was computed similarly by dividing the total cumulative accrued 
expenditures into the cumulative expenditures for classroom training, OJT, work 
experience, PSE, services, and other activities. (The expenditure from the 
goyetnor's 5Z vocational education funds were not Included.) Data came from 
the quarterly reporting forms for all measures of program mix. 
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Ve examined the 12 prime sponsors In the planning study for all quarters 
except September, 1974 , and also for just the end of fiscal year quarters « 
The results of the correlations are sumnarlzed In Table 8. 



The relationships In the 12 planning sites between classroom training 
and OJT (using both expenditures and enrollments) and placement rates were 
less evident than expected. Classroom training expenditures and enrollments 
were moderately associated with the indirect placement measure (PLEFFIC) 
(r*s In the .30 to .33 range) » but not with the overall placement measure 
(PISATE) • OJT expenditures were not associated with either measure of 
placement; enrollment In OJT was associated, but only weakly, with the Indirect 
placement measure but only for the end of fiscal year quarters (£».23). J^th 
classroom training and OJT expenditures were associated with higher costs 
per enrollee (r«.31 to .31) and with higher costs per placement (r«.24 and 
• 33). The proportion of ehrollees- In classroom training and OJT was strongly 
associated with cost per enrollee (r".45 to .76) and to a lesser extent was 
associate., with higher cc^er plac«e»t. 

Vhlle expenditures and enrollments for classroom training and OJT did 
not show the expected strong associations with the measures of placement, 
the proportion of expenditures on work experience did show a distinct de-* 
pressing effect on both measures of placement, but especially on the Indirect 
placement measure (r*s ranged from -.25 to -.AS). Work experience expenditures 
were moderately associated with lower costs per enrollee^ but not with cost per 
placeliient. ^ \ 



The proportion of prime sponsoV expenditures for services was weakly 
associated with Improving performance on both measures of placement (r's frm 
•24 to .29). 

Program mix commitments are fairly manlpulable by staff, and based on this 
blvarlate analysis we could recoqmiend that prime sponsors seeking to Improve 
their placement rates shbuld minimize work experience coiamltmenta^ Resources 
spent^ on services will help Improve plac^ents, but not dramatically. ^The 
apparent lack of a posltpLve relationship ^between coomltments for training 
and placement does not support a recommendation that prime sponsors should 
avoid investing In classroom training OJT, however. We continue to 
believe that placement success and betieflts to the participants are enhanced 
by commitments to classroom training and OJT. 

Combined Effects of Context Variables on Performance 

All the relationships discussed so far have been blVarlate — examining the 
association between pairs of single explanatory factors and single performance 
measures* While this approach can reveal the presence of Important relationships. 
It does not take Into account the effects that other variables may Introduce. 
Prime sponsor staff, of course, do not operate In an environment In which 
only one factor Is Impinging on each performance measure — there are many * ^ 
Interactions occurring between a host of potential explanatory factors and 
performance measures. In the preceding section we employed a verbal and 
qualitative multivariate analysis of. the Impacts that numerous context features 
had on the three models of planning. In this section, we will employ a 
quantitative analysis of the impacts that selected context features exerted 
on performance In the 12 planning sites. The results will prbvlde a descriptive 
map of which factors were Influencing program performance In the 12 prime 
sponsorships In the planning study, and will In effect set a context In which 
to understand the additional Impacts of planning systems and other variables. 
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Table 8: BIVARIATE CORRELATIONS BETWEEN PROGRAM MIX MEASURES AND PROGRAM PERFORMANCE MEASURES 
for 12 Planning Sltea, All Quarters Except September 1974 and End of Fiscal Year (EOY) 
ii ,Quai;^ters IJ 



- 


PLRATE 


PLEFFIC 


NPT 


$ENROLL 


$PLCMT 


All 
Qtrs. 


EOY 
Qtrs. 


All 
Qtrs. 


EOY 
Qtrs. 


A 1 1 

All 
-Qtrs. 


EOY . 
Qtrs. 


All 

All 
Qtrs. 


EOY 
Qtrs . 


Ail 

All 
Qtrs. 


EOY 
Qtrs. 


1 CT Expds. 


2/ 


2/ 


-.31 


.30 


. 2/ 


2/ 


.31 


.51 


2/ ' 


.33 


% OJT Expds. 


2/ 


2/ 


2/ 


2/ 


2/ 


2/ 


.32 


.43 


2/ 


.24 


1 WE Expds. 


-.30 


-.25 


-.46 


-.45 


2/ 


2/ 


-.25 


-.44 


.23 


2/ 


Z SERV Expds. 


.24 


.25 


.29 


.27 


2/ 


2/ 


2/ 


2/ 


.21 


2/ 


X CT Enrollees 


2/ 


.21 


.31 . 


.33 


2/ 


2/ 


.59 


.76 


.21 


*.37 


1 OJT Enrollees 


2/ 


2/ 


2/ 


.23 


2 / 


-.31 


.45 


.48 


2/ 


.25 


/ 

1 WE Enrollees 


-.32 


-.40 


-.43 


-.48 


2/ 


-.26 


2/ 


2/ 


.21 


2/ 


% OTHR Enrollees 


2/ 


2/ 


2/ 


.20 


2/ 


.38 


2/ 


2/ 


2/ 


2/ 



l^A N-45 for EOY quarters; N-165 for all quarters 

! 

2/ Correlation coefficient (Pearson r) less than .20. 
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Use of multiple regression analyala gives the researcher %he ability to 
analyze statlatlcally^and alsniltaneously the effects of aev^eral explanatory 
variables on the dependent performance measure. Multiple regression can 
indicate how much variance the combination of explanatory variables account 
for, and it can Indicate the relative importatice of the explanatory variables. 
While these are Important advances over blvarlate analysis, multiple regression 
is not the ultimate tool of analysis— it has many limitations as well. This 
report is not the vehicle for a treatise on regression analysis, but the 
reader should be aware that the validity and content of the results of 
regression analysis can change — often dramatically—depending on a number of 
factors, for example: 1) the total number of observations (cases) entered 
into the regression equation; 2) the choice of specific quarters to analyze 
<only asid of fiscal year, all quarters, only FY 78 quarters, and so on); 
3) the identity of specific prime sponsors to analyze; the number and 
identity of the explanatory variables used in the equation; 5) the presence 
of statistical association among the explanatory variables in the equation; 
and 6) the assumption of linearity of relationships Imposed by regression 
analysis (as well as correlation) analysis. 

We have trl^ to balance these and' additional considerations in order to 
obtain valid result^. We ran regressions- for the 12 prime sponsors grouped 
together (limitations on the total nuoiber of observations precluded conparing 
prime sponsorships clustered in the three planning models separately). We » 
analyzed data both for all quarters except 9/74 (in order to maximize 
' . observations and increase confidence in the results) and for all end of fiscal 
year quarters alone (in order to make the results of the regression analysis 
consistent with the blvarlate analysis). We selected the explanatory variables 
fiaaed on theoretical concerns and previous research findings; we were also 
guided by the results of the blvarlate analysis., the presence of Interrelationships 
among the independent variables, and the results of other multiple regressions 
not reported here. The resulting list of explanatory factors includes seven 
variables: percent of expenditures for training activities (classroom and OJT 
combined) , the percent of expenditures^ for services , the percent of female 
enrollees, the percent of enrolliees lacking a high school education or 
equivalent, the percent of enrollees tinempldyed at the time of entering CETA, 
the percent of enrollees on welfare, and the quarterly unemployment rate. ' 

The. regressioiy^resGlts reported here should be considered as suggestive 
and descriptive fol^ the 12 planning sites. The results are not generallzable 
to other groyps of prime sponsors, as comparisons below will Illustrate. 

Proportion of Variance Explained . Although regression equations ^yleld a 
plethora of data, we are interesfted primarily In two questions: what is the 
combined Impact of the explanatory variables on a given performance measure? 
(this is discussed In this subsection) , and what is the influence of an 
individual variable relative to the other explanatory variables (this. will be 
discussed in the subsection immediately following the present one). 

Table 9 shows the combined Impact that the seven explanatory variables 
had on each of the five dependent perfojnnance measures. "Variance explained" 
(denoted by the symbol "R^it) ^ statistical concept derived from the procedure 
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Tible 9: PROPQRTION OF yARIANCE EXPLAINE3) (R^) WHEN SEViN EXPLANATORY 
FACTORS ARE REGRESISED OK PERFORMANCE MEASURES* 1/ 

















PLRATE - 


PLEFFtC 


NPT 


$enroll 


$PLCMT 


r2-- 12 Planning Slt^s, 
All Ouarters Eicc^bti 
September, 1974 \ / 

* * * ^ ' 


33% / 




12% 


27% 

* 


36% 


r2^-12 Planning Sites, / 
End of Fiscal tear 
Quarters 


32% ■ 


36Z 


19% 


58% 


32% 



1/ The seven independent variables' are: a) quarterly unemployment rate^ b) pro- 
" portion of expenditures for training activities (classivoo^ andOJT combined), 
c) proportion of- expenditures for services, d> percent enrollees unemployed, 
e) percent enrollees on welfare , f ) percent enrollees without high school , 
degree, and g) percent enrollees female. 
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by vfalch the relationships aiaong Variables are cooputed In a regression analysis •* 
For convenience » we vlll interpret the r2 figure as d guage of the amount of 
change in the performance variable accounted for by the seven Independent 
Variables combined. The slse of the value suggests how Important this group 
of variables la in explaining change in the performance measure^. The smaller 
the value of R the less Influence the independent variables exerted over the 
performance measure, indicating that other factors, not in the equation, were ^ 
accounting for change in the dependent measures. 

As Table 9 shows, the same combination of seven Independent variables- had 
quite different explanatory pover over the different performance measures. The 
combination of participant characteristics, program eigpenditures, and unemploy- 
^ ment rate was least ijnportant in accounting for variance in nonposltlve 
termination rate (NPT) in the 12 i^lannlng prime sponsor^ • The seven variables 
acdotinted for only a small amount of variance in this performance measure (12Z 
for all quarters ^tbgether, and scmieurhat higher 19Z for the end of fiscal year 
quarters together). This result is consistent with the blvarlate correlations 
reported earlier, and does not change. even wl^en, other groups of prime 
sponsors from previous studies were analyziiig using tbe same regression equation. 
This clearly suggests that context variables, at least as measured here, are not 
Important in accounting for changes in nonposltlve termination rate, and that 
. other factors are much more Important, for example, the nature and quality of 
intake, assessment, referral, counseling, and coaching. 

K • . ■ 

The caablnatlon of seven context variables, ^pcotmted for roughly one-third 
of the variance lii the two placement measures . (The figure' was higher for . 
the indirect placement measure for all quarters combined). Although this is 
a higher value than the r2 figure for NPT, it still is not large enough, to. , 
suggest a dominant or controllfiig effect by the independent variables over 
the placonent measures. Two-thirds of the variation in the placement measures 
is accounted for by factors other than unemployment rate/ p«^rtlcipant 
characteristics, and epcpendltures for training and services. The results of the 
regression repeated on other groups of prime Sponsors bnderscored the .limited 
explanatory piower this cluster of Independent variables exercised over the 
• placement measures. In all bf the^ other iregressions , the variance explained 
was lower than the fig^ires reported for the 12 planning sites in Table 9. 



; : =«:L 1 

* One of the .tj^products of the regression analysis is a regression equation 

that estimates the best possible straight line *to represent the' relationships . 
among th«F variables in the analysis. — the pertent of variance explained — 
is a measure of spread^ between the actual values Of the observations and the 
estimated values predicted by the regression equation. The larger the value 
of R?. tile smaller the spread between the actual values and the predicted values 
otthe regression line, indicating a good fit. The maximum possible value of 
'r2 would te lOOZ. The smaller the value of r2. the larger the spread between 
the actual values of observatiqns and the values predicted by the regression 
equation, and the poorer the fit between the actual values and the predicted 

Readers interested in greater elaboration of regression analysis may 
- consult Blaltock, 1972: Chapters 17-19.. « 
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The seven* Independent variables coinblned accotoited for roughly one third 
of the variance In the two cost efficiency measures The' Implications of this 
general result again are that there Is a large margin of variance unaccounted for, , 
meaning that factors other than program mix es:pendltures, participant ^ / 
characteristics and unemplo3^ent rate are more Important In explaining variation 
In cost per enrollee and cost per placement. This conclusion Is strengjuhened 
when the regressions were repeated for other groupist of prime sppnsors for which 
data were available*^ In all of the other regressions, the total variance , 
explained In the two cost measures was lower than the figures for the 12 
planning sites* In none of tlie other regressions did the figure exceed 
22Z for either cost measure or for either sample of quarters. This fact 
underscores the atypical nature of the muisually high R for the 12 planning 
sites for end of year quarters for the cost per enrollee measure. * * ^ 

Recapitulating the results of the total variance explained for the 12 
planning sites, the combination of seven different measures of context, each \ 
presumed by practitioner and conventional wisdom ta pose significant constraints 
on program performance, displayed only limited impact when regressed on each * 
of five measures of performance (with the single exception of cost per enrollee, . 
v^ere the Impact was greater). ^ The general conclusion is strengthened when 
coidparisdns are made to other groups of ^rlme sponsors; these comparisons 
show the proportion of ^otal variance in the dependent measures explained to s 
be even less. / . ' 

The implications of these results for prime sponsor staff are that even 
within a context of unemployment rate, prograsmatic expenditures for training 
and services, and participant clliaracterlstlcst there is plenty of latitude for 
the staff "^o affect program performance; factors other than these features 
of context are more Important in e:^lalnlng changes in performance. 

The Impact of Individual Variables . Given the relatively small proportion 
of 'total variance ^3q)lained by the cluster of seven context variables, given the ^ 
fact» that the proportion of variance explained was ^ven smaller in comparlspn 
groups^ of. prime sponsors , and given that ^the precise interrelationships among 
the independent variables is subject to change as variables are added or deleted, 
we opted not to devote excessive space to describiJLng the r^elative Influience 
and interrelationships of the seven explahatory variables in each regression.^ 
The most Important variables in each regression equation can be identified^ 
(using standardized regression coefficients (BETA, s) to determine relative • 
t © Influence), however, to help sort out the results of many of the blvarlate » 
N^ssoclatlons reported earl^ler and to indicate which, single variable among the 
seVen exerted the most Influence on the dependent performance measxires when the 
effects of a ll the o ther esfplanatory factors were statistically controlled for. * 

. ^* 

The regression analysis showed that for both 'measures of ' placement the- 
percent of enrollees lacking a high school degree was the most Important variable 
in the regression equation, and that it es^hibited ISl net negative effect on both ^ 
measures of placement rates. ' (This result was present for bot:h all quarters and 

* The differences in Table 7 between the for all quarters and the R^ for 
Just end of year quarters were reasqjaably small for all the performance 
measures except for cost per enrollee, when the R increase4 from 27% to 5SZ 
for the end of ye^r quarters alone. There is no apparent reason for such a 
large qhange — changes in other groupings of prime sponsors were very small-- . 
except for a unique statistical association among the data points for the 
12 planning sites for l^se points in time. The large R figure is not V_ 
typical of^ the other groupings of prime sponsors examined, all of which 
showed very low R figures on this dependent measure. 
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end of fiscal year quarters.) The strexigth of this participant characteristics 
Is consistent with the relatively strong inverse blvarlate relationships reported 
earlier for percent of enrollees without high school degrees and the placement 
'measures. The regression results indicate that even in the presence of other 
explanatory factors, each of which exhibited some Independent association 
with, placement rates, the percent of participants without a high school degree 
Is the most Important factor affecting the dependent variable. (This "most 
important" label la relevant only in the context of the total variance, explained 
by all the Independent factors together. Recall that the total variance 
explained for the placement measures was about 33% — the percent' of enrollees 
Without a high school degree was the most important of seven variables that — 
together accounted- for roughly one third of the ch^ge in the placeaent rates 
of the 12 planning prime sponsors.) 

The percent of expenditures for training activities was found to be 
unimportant In explaining variation in the placement measures for the 12 
planning Sites, even when the effects of the other six variables were controlled 
for. While consistent with -the .earlier blvarlate results that shoved only a weak 
or absent relationship between training comnltment and placement rates, this 
finding is inconsistent with experience and conventional wisdom that suggests 
a strong relationship exists between the coiomltm^t to training and the 
placement rates. When the regression analysis was repeated for other comparison 
groupings of prime sponsors the results did confirm the expected relationships. 
For the 30 prime sponsors not In the planning study, the expected relationships 
between training expenditures and placement rates were present, both in 
blvarlate and regression analysis results, and the proportion of expenditures 
for training activities was the most Important single variable in the regression 
analysj^s. , . • 

For nonpositlve termination rates , in the 12 planning sites, the unemploy- 
ment ratei was the most Important single explanatory variable, but the importance 
of this variable must be assessed in the context of the very low total amount of 
variance accounted for by the seven variables together. 

The percent of expenditures for training activities was foimd to be the 
most Important single explanatory variable in the regressions for both measures 
of cost efficiency . ^ 

» 

Conclusions from the Regression Analysis . Regression analysis helps 
enlarge understanding of variance in the performance measures' by considering 
more than one explanatory factor at a time. The analysis reported here 
regressed seven independent variables on performance measures. The seven 
Independent variables were selected because tney posed ^ at least pot^tially, 
large constraints on performance, with a concomitant diminished degree of staff 
flexibility and latitude to alter performance. The results of the regression 
analysis lead to the following conclusions: 

1. A low proportion of variance in the dependent performance measures 
is explained hy the unemployment rate, program expenditures, and demographic 
characteristics of participants, rhe^re is a great deal of latitude for prime 
sponsor- staff to affect program performance , even after these factors have 
been taken into account. This result is true for the 12 planning sites as 
well as comparison groups of prime sponsors. 

• V 

2. * Unemployment rate, is the single least Important explanatory factor 
affecting change in the performance measures among the planning sites. This 
is consistent with the blvariatp .results discussed earlier and with research 



results reported elseidiere (Ripley and associates* 1978), but It runs 
counter to xonventlonsl wlsdoin. The point that needs to he made to laanpower 
staff la that uneaployment rate may he having a greater Impact on the hearts 
and minds and perceptions of staff than It Is actually having on prime sponsor 
program performance. Attitudes about the impact of unemplo3^ment may be a much 
greater constraint on performance than the actual unemployment rate. 

3. The detttographlc characteristics of participants do riot control 
performance. The multivariate results underscore and strengthen our earlier 
conclusions derived frcau blvar late analysis. For only two of the performance 
•measures vas^a demographic, characteristic found to be the most Important 
explanatory factor. For both of the placement measures, the percent of 

^ enrollees without a high school diploma exerted dominant Inf luence. In the 
direction of lower placement rates. For the other measures. of performance , 
^ demographic characteristics were not the most Important exf/ianatory variables. 

4. The proportion of expenditures for training activities (conblnlng 
classroom and OJT) was not Important In accounting for variance In the place- 
ment measures In the 12 planning sites. The percent of training expenditures 
was the most important variable accounting for changes In the variance of both 
measures of cost efficiency. These results were consistent with the blvarlate 
relationships among the 12 planning sites , but they were surprisingly different 
from common expectations about the association between higher training coismltments 
and better placement rates. Regression analysis using comparison groups of 
prime, sponsors upheld the expected relationships, however. 

5. The 12 planning sites are not representative of other groups of 
prime sponsors, and generalizations from the planning sites based on the 
-regression analysis must be limited. The regression analysis results accurately 
portray the effects that seven context variables exerted on performance 
measures for the 12> planning sites, sites chosen for analysis because of the 
good reputation^ of their planning systems, and these sites are not necessarily 
typical of other prime sponsors.^ In comparisons with other prime sponsor * 
groups, the regression analyses were repeated with the^same cluster of 
explcuiatory variables, and they were found to have less potency In 
accounting for variance in the performance measures. Additionally the relative 
influence of individual variable^ changed. 

C. RELATIONSHIPS BE^EN MANAGEMENT VARIABLES AND PERFORMANCE 
• 4' 
Unlike the contextual (or external) variables used to explain program 
performance in the previous sections, the concepts in this section, falling 
under the rubric of management decisions, were chosen to reflect qualities of 
and proce&ses within the CETA sta^f organization itself. In general, we focused 
our attention on three broad categories of management indicators: staff 
characteristics, administrative characteristics, and relations with other 
actors. Values for the inddl^cators designed to measure these aspects of 
management decisions were arrived at through 1) the observations., of two-person 
teams who spent about two separate weeks in each prlme^ sponsorship, 2) review 
of prime sponsor documents, and 3) extensive interviews with staff, service 
deliverers, advisory council members, and other local manpower actors. 

Among the cluster of staff characteristics we included quality of top 
staff and quality of all staff. Quality of top staff reflects tne professional 
capabilities, experi-ence, and qualifications of the management level staff in 
a prime sponsorship (the director, deputy director, and division or unit heads). 
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It Is not limited to just the plaimlng staff. Quality of all staff represents 
sloQillar judgments covering all of the professional staff. For both measures, 
rating categories were very good» good and fair. Both measures are subject 
to manipulation by staff (staff members can be upgraded by hiring practices 
and In service training courses » among other things). ^ 

In the administrative characteristics cluster, ve Included prograstaiatic 
integration 9 administrative integration, and characteristics of planning 
systms. Programmatic Integration refers to the ability of CETA participants 
to move within Title I program components and to move between CETA titles. 
Batlngs of mobility ranged from high to low for this variable, which is highly 
manipulable by staff. Administrative inteeration reflects the degree to which 
administration of Titles I, II, and VI is handle by separate staff units or 
by the same staff. Ratings ranged from high administrative Integration (the 
same staff people oversee all CETA titles) to low (completely separate staff 
units administer the titles). This is a variable that is moderately manipulable 
by the st^ff In the short run. 

The features of planning systems that we examine Included responsibility 
for service delivery, use of HFPs in selecting service providers, quality of 
monitoring, ai^lrquallty of evaluation. Responsibility for service delivery 
refers to the(^local arrangements for providing manpower services, and indicates 
whether services are entirely subcontracted, entirely run In-house by prime 
sponsor staff, or whether a mixed mode of delivery is u^i^. This is a variable 
that is moderately manipulable by the staff. 

The use of RFPs indicates the extent of the staff *s use of requests for 
proposals in the selection of service deliverers, and the formal or informal 
nature of those RFPs. Ratings ranged from high reliance on formal RFPs to no use 
of RFPs; The quality of monitoring refers to the staff's supervision of 
subcontractors and staff units responsible for service delivery to participants. 
Monitoring techniques range from high (extensive use of quantitative and qualHratlT^ 
program reviews based on monitors^ field visits and desk reviews) to low 
(limited. Infrequent program review, based on desk review only). The quality of 
evaluation refers to the staff's assessments of the systmwlde perfoxjaance of 
manpower programs and reflects jthe nature and extent of such reviews. Ratings 
ranged from high (extensive quantitative and qualitative aspects in widespread 
program evaluations) to low (minimal evaluation, stressing. only a few quantitative 
measures)^ The use of RFPs, the quality of monitoring, and the quality of 

evaluation are all highly manipulable by the manpower staff. 

i 

In the cluster of management indicators called relationships with external 
actors we Include the role of the Employment Service as a service provider, 
the Involvement of business in manpower programs, and the level of conflict in 
the prime sponsorship. The ES role refers to the degree to which ES provides 
manpower services in the prime sponsorshilp. Ratings ranged from high to low 
and reflected whether the ES received a substantial proportion of the prime 
sponsor* 8 Title I budget to provide at le^at two different functions (such as 
OJT and Intake services) or whether the ES had no role or only a Alnlmal role 
(for example, verification of placements). The extent to wKich the staff 
actively solicited and obtained a role for business in manpower decisions and 
programs resulted J.n ratings that ranged from high, expli it business Involvement 
'(for example, business w^s Involved in service delivery, or staff conmltted a 
large portion of funds to OJT, or placements were made In the private sector 
as a result of aggressive staff efforts) to non-involvement of business other 
than nominal monbership on the manpower advisory council. The lev^l of conflict 
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in the prime sponsorship Is a measure of the nature and extenslveness of 
manpower-related disagreements within the prime sponsorship. This measure 
also serves as a rough indicator of the staffs* ability to control conflict 
with existing conflict resolution strategies. Unfortunately, we do not have 
an alternate measure of conflict resolution capabilities available. The 
ratings range from high to low conflict, reflecting a broad systemwlde 
assessment of conflict over manpower Issues In g^eral, rather than conflict 
over specific single Issues or decisions. (This measure of conflict Is 
« broader than the measure of conflict used In the previous section of report 
on planning systems, where conflict assessments were restricted to conflict 
engendered by specific decision areas.) In general, relations with external 
actors are moderately manlpulable by the staff. ' 

• Table 10 presents the relationships between the management variables and 
performance vatlablea (using the on-site quarters only) I for the planning sites. 
Additional analyses of these relationships were conducted by subsettlng our sites 
according to the type of planning system. Subsettlng by future orientation 
proved fruitless because of the small number of cases and the extremely small 
• amount of variation among them. Subset ting by operations management orient^ 
sites and future oriented sites together while excludlxig the fcrlsls management 
site affected the results enough to warrant presentation and discussion of 
the differences. We did not do great violence to the analysis by falling to 
pursue the differences between future oriented and operations management 
sites separately, both for the laethodologicdl reason cited above and because 
the two groups are considered to be similar in termb of management capabilities. 
Tlje important difference with respect to managdTent capabilities Is between the 
crisis management model on the one hand and the futute oriented models on the 
* other. The crisis management site was characterized by a breakdown in 
management capabilities and control, while in the Operations Management and 
future oriented systems, management capabilities remained Intact and able to 
cope with external pressures. 

In general, the table shows that the management of 12 prime sponsorships 
combined are more strongly associated with the nonpositlve termination rate than 
were the unemployment rate, program mix expenditures, or participant characteris- 
tics, and that the management variables help to decrease t^ie nonpositlve te^lna- 
tion rate. The management variables showed almost no association with the 
cost measures, and therefore the cost efficiency measures of performance were 
not Included in the table for the sake of brevity. The characteristics of the 
sta;ff were the most strongly associated with the placement measures and the 
nonpositlve teimtnatlon rate, followed by the extent of business Involvement, 
the quality of monitoring, the degree of program integration, and the quality 
of evaluation. 

Among all 12 pltonlng sites. Table 10 shows that both the quality of top 
staff and the quality of all staff had an identical, positive association with 
the two measures of placement. Quality of top staff and of all staff were only 
weakly associated with increases in the overall pl^acement rate (r'a - .26 and 
.27), but these factors were significantly related to the placement efficiency 
measure (both r's - .42). These results reinforce our earlier findings 
(Ripley and associates, 1978) and the connnon sense expectation that the 
nature of the people in the prime sponsor staff does affect the nature of 
program performance. Directors have good reason, therefore, to seek to enrich 
staff competencies through use of management courses and in-service training 
courses for their staff members. 
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Table 10: Blvarlate Relationships Between Management Variables, and 
Performance for the 12 Planning Sites ^ and the Planning * 
Sites Excluding Deiwer, On-Slte Quarters jL/ 



■ 


li PlanWg Sites 2/ 


Planning Sites Excluding 
Crisis Management Site 2/ 




PLKATE 


PLEFFIC 


NPTRATE 


PLRATE 


PLEFFIC 


NPTBATE 


Staff Characteristics 














Quality Top Staff 








.11 


.53 


11 


Quality All Staff 


.27 


.42 




3/ 


.59 


3/ 


Administrative 
Characteristics 














Programmatic 
Integration 


O / 


• 36 


-.29 


1! 


.47 


11 


Administrative 
Integration 


o / 


o / 




-.22 


1' 


-.26 


Opexatixig^ Re- 
sponsibility 


3/ 


11 


3/ 


3/ 


3/ 


1/ 


Use of RFP's 


3/ 


3/ 


3/ 


3/ 


3/ 


.20 


Oualltv of 
Monitoring 




• JD 


— .■34. 


11 




3/. 


Quality of 
Evaluation 


.28 


3/ 


-.27 


3/ 


.26 


3/ 


Relations with Others 














ES Role 


1/ 


3/ 


-.32 


3/ 


3/ 


3/ 


Business Involvemenl: 


.31 . 


.38 




.21 


.36 


3/ 


Level of Conflict 


3/ 


3/ 


/ 

3/ 


3/ 


3/ 


-.29 



V Number of observations Is 35 for all 12 sites, and 32 for the subset that 
excludes Denver. 



2^1 $ENROLL and $PLCMT were not presented due to the low number of significant 
relationships (five) . 

2J Indicates the Pearson r correlation coefficient was less than the cutoff of ,20. 



Hany of the program and planning characteristics In the 12 prliae 
sponsors were associated with placement or nonposltlve termination performance. 
Programmatic integration (the extent to which participants move within Title I 
components or between titles) was fairly strongly related to Imptoved placement 
efficiency (r - .36) and was sbmewhat related to better performarice on 
nonposltlve terminations (r - -.29). The quality of moriltorlngi-an Important 
part of the operations management and jthe future oriented planning systems, 
was fairly strongly related to Improved placement efficiency rates (r « .35) 
and to better performance on nonposltljve terminations (r - -.32). The, quality 
of evaluation, another characteristic lof planning dystems, was related to 
placement and nonposltlve terminations!, although not as strongly as the 
preceeSlng factors (r - .28 for overall placement rate and -.27 for nonposltlve 
terminations) . The nature of evaluation was not related to the pT.acement 
efflcl^cy measure, however.; These results suggest that the prime sponsorships 
in our study were able to Improve placements, particularly indirect placements, 
and to decrease nonposltlve termination rates, by exposing participants to a-*^ 
variety of CETA services rather than just one activity, and by rigorous 
monitoring of subcontractors. The blvariate correlations did not reveal 
relationships between placement rates, or nonposltlve terminations and other 
features of planning systems, including use of KFPs, operating responsibility 
(In-house delivery vs. subcontracted delivery of services) or administrative 
integration of titles. (Administrative integration was fairly strongly 
associated with decreasing nonpositiye termination rates, however.) Bather 
than concluding these factors are not important or are not related to 
performance, it is more likely that their effects are indirect, and are being 
masked by other variables. ^ 

Of the indicators of prime sponsor relations with external actors, only 
the level of business involvement was associated with the placement performance, 
-^n those prime sponsorships where the staff had solicited and obtained an 
active role for the private sector, placement performance tended to be better 
(r*8 were .31 and .38). A close working relationship with business can 
contribute to better placement in at least two ways. First, by gaining direct 
access to the private sector labor market through involvement of local 
businessmen, placement performance is enhanced', and second, by using the labor 
market information gleaned from business contacts CETA planners are better 
able to develop training programs that more closely reflect employment 
opportunities in the local labor market. The use of ES as a subcontractor and 
the level of manpower related conflict in the prime sponsorship were not asso- 
ciated with placement performance in the 12' prime sponsors, although there was 
a moderately strong tendency for the prime sponsors that^used ES extensively as 
a subcontractor to have better nonposltlve termination rates than prime 
sponsors that| did not use ES as heavily. 

There were few relationships between any of the management Indicators 
(including some planning system characteristics) and performance on the cost 
efficiency measures. The quality of monitoring showed a weak association 
with higher costs per enrollee (r - .27), and in the prime sponsors with high 
business Involvement the cost per placement tended to be lower (r - -.30). The 
level of manpower related conflict in the prime sponsorships was surprisingly 
associated with better performance on both of the cost measures, and the^ 
associations were moderately strong (r*s - -.36 and -.30). 

While the above coriclusions, derived from analysis of all planning sites, 
generally hold up when the analysis is relocated while excluding the Crisis 
Management site, some noteworthy differences da occur. The relationships 
between staff quality and placement efficiency are enhanced (from about the 
.4 l^el to between .53 and .59), though the relationship with NPT is reduced 
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to Insignificance* A similar pattern holds for the relationship of program 
Integration with PLEFFIC and NPT. The relationships of administrative - 
integration » quality of monitoring, quality of evaluation, and ES role with 
NPT also follow the same pattern* The most strll^ng difference between the 
two samples Is In thp difference between the quality of monitoring and 
PLEPFIC relationships^ The magnitudes of the coefficients Increases frpm .35 
to .SA, the largest in Table 10. This dramatically underscores the Importance 
of good monitoring. Finally, the relationships business Involvement and the 
level of conflict with cost per placement are reduced to Insignificance. 

In summary, the differences between the 12 planning sponsorships 
contrasted with only those whose management systems are functioning adequately 
lie primarily in the stronger relationships for the latter group between 
management indicators and the placement measures', especially PLEFFIC, 
and the general decrease in the relationships Involving NPT. 



D> RELATIONSHIPS BETWEEN PLANNING SYSTEMS AND PERFORMANCE 

Expectations of Relationships 

In general, assuming that the contexts and Implementation factors are 
relatively similar, we would expect that those prime sponsors operating with 
a Crisis Management planning system would demonstrate worse performance ^ 
figures than prime sponsors operating with either an Operations Management 
or a Future Oriented planning system. The net effecit of unstable influence 
^l^elationships , unmanaged conflict, a lack of routine in decision making, ^d ^ 
a dysfunctional feedback system Is the generation, of poor and Inappropriate 
planning decisions. These decisions, in turn, will probably lead to negative 
effects on program performance. For example, in a prime sponsor with unstable 
Influence relationships and unmanaged conflict, the staff mAy have difficulty 
in achieving congruity in planning decisions and flexibility In adapting td 
change when necessary.- The service deliverer decisions may reflect this 
difficulty. Uhen it becomes clear that certain service deliverers should^ 
be dropped or cut back because they refuse to change their programs to keep 
abreast of the changing Job market demands, the staff may be unable to act 
because of the entrenched strength of the existi/Jig^ service deliverers. In 
this situation, the decision may be made to keep them and their services. 
If the situation persists, both lower placement and placement efficiency - 
rat^s can result. 

Serious performance problems would also be expected to result in a Crisis 
Management site because of the lack of a functional feedback system. This may 
make both service deliverer evaluations and target occupation decisions particularly 
difficult. Without an effective monitoring operation, the quality of training may 
decrease without staff detection. Consequently, without corrective action, 
ill-prepared clients will emerge and placement rates and quality of placements 
couid be dimaged. In addition, without a feedback system that keeps abreast 
of the changing nature of Job occupations available in the area, the target 
occupation decision may often be outmoded and inaccurate. Consequently, the 
training programs that are designed on the basis of this identification will 
provide people with -skills that may be difficult to market. Thus, placement 
rates and the quality ofe^ placements would be predicted to decline. 

In general, we would not predict much difference In the performance 
measures between sites that fall into the Operations Management or the Future 
Oriented planning systems. In^these sites, the decision making processes 
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for planning are basically the same. Stable and well-oiled operations with 
functioning feedback systems that do supply important information In a timely 
fashion would be in plabe. Well thought out planning decisions should result ^ 
and the performance consequences should be positive. 

However, as the discussion below illustrates, there is sane evidence to 
indicate that the future oriented sites performed slightly better, on the whole, 
than the operations management sites . We would like to suggest that these 
differences could, in part, be explained by the presence of distinct forms 
of Job market feedback mechanisms that appear in the future oriented sites. 
While all details of these mechanisms could not be explored, we did observe 
that the mechanisms focused particular attention on involving the business 
conanunity: Rough Indicators show that the future oriented sites did. have 'higher 
and more explicit business involvement than other sites The form of this 
involvement varied. In Baltimore, formal Labor Market Advisory^ Councils were 
established as the institutionalized link with the private sector. In ^ 
Penobscot, the mechanism was more inforaal. In addition to utilizing job 
developer information, the director keeps abreast <Jf business activity by 
attending Chamber of Conmerce and Rotary Club meetings in the area. 

Uhlle conclusions from these few examples can only be tentative, we would 
like to suggest that the examples indicate the usefulness of institutionalizing 
relationships with the business coiaflunlty. Certainly the correlat^ns between 
business involvement and placement "Vatcs, presented la Table 10, supports this. 
This relationship can be utilized not only for job plajpements but also for 
linger term forecasts of labor demands. (From this perspective, the purpose 
of Private Sector Incentive Program, with its PIC council, makes sense. 
How well it works in practice, of course, remains to be seen and depends, 
at least in part, on the details of implementation in pfrlme sponsorships.) 

Observed Relationships Between Planning Models and Performance 

Examination of performance data for each of the twelve sites and each 
of the three planning models reveals general support for the expectations 
suggested above. In general, Denver, the Crisis Management site, compared 
unfavorably with the other sites and models using standard measurias of 
performance. (Data about Denver is only presented here as being suggestive 
of what might be found in other sites fitting the crisis management description; 
in no sense is It predictive or generallzable since it is only one case.) 
In general, the Future Oriented sites performed somewhat better than the 
Operations Management sites but the difference is not great, and if the sites are 
examined individually (Tables 11 and 12), a good deal of variation among sites 
emerges . , ^ 

^ ^ 

Table 11 shows, for example, that although the Future Oriented sites, on the 
average, performed better than the Operations Management sites across all five measures 
there are Operations Management sites that performed equally well (for example, 
San Francisco and Bergen. County) . Additionally, there Is at least one Operations 
Management site that more closely resembled Denver that the other Operations Manage^ 
ment sites (I.e. Omaha) along the selected standards of performance. 

If each of the\ sites is examined for each of the quarters in which 
the, study took place (12/77-6/78), much the same pattern is present (Table 12). 
There i&'little difference between the Future Oriented and Operations Manage- 
ment sites, and^thejre is a rather extensive variation within the models, 
especially within the Operations Management model. In general, the 
Future Oriented and 0peratloii6 Management sites (with the notable 
exception of Omaha) show a pattern of Improved performance on the 

5^ 
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Table 11: INDICATOSS OF PERFORMANCE^FOR 
PLANNING PRIME SPONSORSHIPS, JT3NE 1978 



Prime Sponsor 


PLRATE 


PLEFFIC 


NPT 


$ENR 


$PLCMT 


Futixre Oriented 




* 








Baltimore 


46 


^ 20 . 


14 


. $633 


$1378 


. Penobscot 


31 


23 


21 


$997 


$3266 


Syracuse 


A3 


21 


lA 


$1306 


$3059 












■ 


FO Average 


AO 


21 


16 


$979 


$2568 


.v#pexau4U|io nanageiiien u 












San Francisco 


A3 


25 


20 


$1A31 


$3332 


Bergen County 


39 


26 


21 


$i353 


$3A76 


Gulf Coast 


35 ^ 


6 


7 


$13A6 


$3884 


; Heartland 


Al 


6 


2A 


$779 


$1907 


4 












Atlanta 


36 


22 


37 


$1053 


$2960 


Omaha 


25 


19 


30 




1/ 


Albuquerque 


34^ 


18 


*27 


$953 


$2775 


Klng-Snohomlsh 


28 


23 


18 


$1675 


$6027 


OM Average 


35 


18 


23 


$i227 


$3A80 


Crisis Management 












•s^enver 


23 


17 


A3 


$6A2 


$2808 


U*S. Average 


28 


15 


29' 


$1091 


$39A0 



1./ Correct data not available. 



« 7Q 

60 




Table 12: INDICATORS OF PERFOKMANCE FOR PLANNING 
PRIME SPONSORSHIPS, 3 QUARTERS IN FY* 78 



Prime Sponsor 


PLRATE 




PLEFFIC 


— ^ 


. NPT 


12/77 


3/78 


6/78 


12/77 


3/78 


6/78 


12/77 


3/78 


6/78 


:ure Oriented 

m 




















ial timer e 


28 


40 


46 


12 


17 


20 


15 


17 


14 


• 

'enobscot 


1 "7 

17 


/J 


31 , 


13 


18 


23' 


1/ 


1 o 


n 


Syracxise 

• 


21 


33 


43 


11 


16 


21 


9 


12 


14 


orations Management 


• 


















>an Francisco 


24 


37 


43 


14 


23 


25 


.25 


21 


20 


3ergen County 


20 


32 


*39 




22 


26 


19 


18 


. 21 


3ulf Coast 


16 


27 


35 


2 


4 


5 


5 


6 


. 7 


leartlaxid 


27 


36 


41 


2 


4 


6 


19 


24 


24 


Vtlanta 






JO 


12 


17 


22 




Jo 


J/ 


Dmaha 


25 


35 


25 


19- 


24 


19 


30 


30 


30 


Ubuquerque 


15 


26 


34 


7 


12 


18 


19 


22 


27 


Ung-Snohomlsh 


13 


22 


28 


11 


18 


23 


25 


15 


18 




















Lsls Management 




















Denver 


23 


31 


23 


19 


24 • 


• 17 


32 


33 


43 



• . so 



three oeasures, particularly on placei&ent rate (PlilATE) and placement 
efficiency (PLEFFIC) , while Denver shows an erra^lc^ and generally declining 
pattern of performance. „ 

Table 13 compares the Future Oriented and Operations Management model 
averages for three standard Indicators of performance during FT 78 » and shows 
a statljStlcally significant difference between the models on placement rate, 
placement efficiency, and non-posltlve termination rate (I.e., If other sites 
were studied and placed In the models, there Is better than a random chance 
that similar differences In the performance Indicators would be present.) 
Denver Is not compared statistically to the other two models because It Is 
Impossible to argue that It Is statistically representative of other Crisis 
Hanagement sites (mean performance Indicators are simply presented to provide 
rough comparison with othet models). 

One of the features differentiating the Future Oriented sites from the 
Operations Han^ement and Crisis sites la a deliberate long-range programmatic 
orientation. Future Oriented sites make program decisions based In part on 
how they want their pianpower delivery system to perform several years froni the 
time the decisions are made. Table 14 presents some data on change In three 
performance measures, change that is at least partially attributable to differences 
In the planning models. The Future Oriented site^^show the most Improvement 
in placement rate and in placemeht efficiency, while Operations Management . 
sites Improve ilLO a lesser extent, and the one Crisis Management site shows 
a decreasing performance on all three indicators. Although the Operations \\< 
Managemient sites show wpre substantial Improvemtot on non«-posltive terminations 
(NPT) , the Future Oriented sites performed at a higher absolute level In 
6/78, which could possibly be an optimal^ level of performance. By 6/78, the 
Future Oriented sites were showing the msot positive level of performance 6n i 
all three Indicators, and Denver was showing the most negative level* (both in 
absolute level of performance axul In the amount of change from 6/76) . 

The results of planned versus actual comparisons on 'selected measures for 
the 6/78 quarter are shown pi Table #15. They substantiate the expectation that 
program perfori&ance In a Crisis Management dite will not be as good as perfor-. 
mance in Qlther the Operations Management sites or th& Future Oriented sites. 
The data do not reveal any systematic idlfference in the^erformance of the 
Operations Managesaent sites as compared to the JltLtur^^Drlented sites. 
Generally, both tht Future Oriented and Operations Managment sites came very 
close to meeting their planned goals of enrollments, expenditures, placement 
rates (PLRATE), placement efficiency (PLEFFIC), and non-positiv6 terminations 
(NPT) — ^varying froiji the planned figures by no more than a few percentage 
points. Denver, on the other han4, varied from its planned rates of achlevettient 
by as much as 26Z (enrollments), and varied from at least three other of its 
goals by a minloium of 17Z. f 

Summary . As expea^ted, the evidence discussed above Indicated that the 
Crisis Management site had poorer performance scores than either the Opera- 
tions Management sites or the Future. Oriented sites, regardless of how performance 
was measured or analyzed* Using the standard indicators of performance, the Crisis 
site generally showed the worst performance of any of the twelve sites, moving 
from reasonably good performance In. FY 76 to unsatisfactory levels of performance, 
an4 showing extensive devflation from its planned performance levels. 



Also, as expected, there was little difference between the pei^formance 
levels of the Operations Management model and the Future Oriented model. ^ 
Taken ' separately, the sites exhibited wlde--ranging performance levels with 
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Table 13: A Comparison of FJ 78 Perfomance .for Planning Sites, by Model 



a 



Sites 


PLRATE 


PLEFFIC 


NPT 


Future Oriented (N-3) 

Opetatlons Maxiagement 
(N-8) 


31.3%^ 
28.52'' 


17%^ 
155L' 


22Z'' 


* — : 

. Crisis Management 
(N-1) 


26% 


20% 

4, 

• 


' 36% 




1/ U§lng a one-tailed T-test, this difference Is statistlpally significant 
^ at .0005 l^vel. 

2J -Thi^ difference is statistically significant at a .005 level. 
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Table lA: Change In. Ferfarmance Indicators, 6/76^ to 6/78, 
, for 'Planning Sltes^ by l^del, and U.S. Average 



(- 







—t 

PLEATE 


f 


PLEFFIC • 


NPT 


.Model 




6/78 


Change 


6/76 

• 


6/78. 


Change 


6/76 


6/78 


Change 


Future Oriented Sites (N«3) 


23 


40 

» 


+t7 


11*' 


21 


+10 


25 


16 


-9 


Operations Management Sites 
(N-8) 


31 


35 


+4 - 


19 


18 




' 37 


123 


-14 


Crisis Management Site (N^l) 


54 


23 


-31 


26 


17 




'25 


43 


» 

+18 


U.S. Average 


22 


28 


+6 


11 


r 

15 


+4 


32 


29 


-3 

• 



S3 



Table 15: Comparisons of Planned vs. Actual Performance on Select;pd Indicators for 6/78 

for the Planning Sites, by Mod<Bl 



Measure 1 


Operations 
Managonent 
(8 sites averaged) 


Future 
' ^ Oriented 

(3 sites averaged) 


Crisis 
(1 site) 


Percent of Plan Achieved, 

' Total Enrollments 

* ^ 1 




97% 


. 126% 


*» 1 
Percent of Plan Achieved, 
Total Expenditures 


1 - 96% . ^ 


93Z 


80% 


» ^ Planned PLBATE vs. 
Actual PLRATE 


1 4 percentage 
points 
less than plan 


J percentage 
. more than plan 


19 percentage 

points 
less than plan 


Planned PLEFFIC vs. 
Actual PLEFFIC 


1 4 percentage 
1 points 

less than plan 


5 percentage 

V points 
more ^han plan 


V 


Plann/sd NPT vs. Actual 

^ NPT 


11 ^ 

I 1 percentage 

II point 

1 lesd than plan 


1 percentage 

point 
less than plan 


17 percentage 

points 
more than plan 



1/ Data not reported for planned figures. 



soae.pperatlons Management sites looking aore like Future Oriented sites than 
the rest of the Operations Management sites, and with other Operatlona Manage- 
ment sites looking more like iriiat Is expected from a Crisis Management site. 
Taking each'model as a whole, small, and sometimes significant, differences 
were found on the selected measures of performance with the Future Oriented 
model usually showing a stronger level of performance when compared with the 
Operations Management model. The Future Oriented model also seemed to 
most able to effectuate substantial cl^ange In performance by surpassing the • 
rates achieved by the Operations Management model. Sites using both models 
were clearly able to perform at about planned levels. 

I 

E. CONCLtfSIQNS . , 



Summary , • 

« 

In the preceding sections, we have systematically Investigated the 
relationships between Indicators of local context, management characteristics, 
and planning with Indicators of program performance.. The diagram below 
summarizes the general, relationships that we have found In the }.2 planning 
sites. The broken lines Indicate that the relationships were only weak or 
nonexistent; the solid lines Indicate that a definite relationship. was 
preset. (These relationships are consistent with previous findings reported 
In Ripley and Associates, 1978.) • 
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As' In Section H J where we saw that the staff was able to ccHXtrol the 
nature of their planning systems by conscious manipulation of selected elements 
9f their management environment , the most striking theme 'Merging from the 
analysis of program performance Is the degree of control that prime sponsor 
staff can exert over their program performance. If we classify the Indicators 
t)f context and manag^ent characteristics In terms of the fxtent to which the 
staff can directly control or shape them, a very Interesting pattern emerges: 
ThB explanatory factors that are more manip^lable by staff are the ones that ^ 
tended to be most highly associated with performande variations in a positive 
way, wherr^as the explanatory factors over which the staff can exert less 
direct control were not strongly associated with performance variations* 
This evidence suggests strongly that prime sponsors seeking to Improve their 
program perforibantre can do so by focusing ai\d directing attQg^^i^n on manlpulable 
elements of. thel'r^ local environments, especially on elements of management. 
Program .per forniance can be improved 111 this manner.. Improvements In program 
perfprmance are not much constrained by less manlpulable elements of context . 
such as economic conditions and demographic characterlstlts , despite the 
contrary assertions of conventional wisdom. 




The factors that we found to be most strongly associated with better 
performance were the quality of the stjEiff, the nature and extent of business 
involvement, and the quality of monitoring. All of the factors are highly 
manlpulable by staff. We would encourage any prime sponsorship seriously v 
Interested in Improving program performance to take steps in these areas. 



Quality of staff can be improved through such measures as engaging in 
very deliberate and careful hiring decisions; providing in-house training 
(available from CETA consultants and DOL seminars, for example); exposiog 
key\ professional staff to all parts of the local manpower delivery system's 
administration (thus fostering diversity in staff experience); temporarily 
exchanging staff with other prime sponsors or with local delivery agents; and 
granting staff time off for formal education leading to professional development. 

Quality of monlto^ciiij^ can be strengthened in a number of way a, including: 
clear assignment of a staff person to each subcontractor (to give the deliverer 
a direct liaison to the staff); regular visits to subcontractors (twice a year 
at least) ; frequent (dally or we^ly) telephone contiact between the staff 
monitor and the subcontractor (keeping the lines of coiamanication^pen) ; 
inclusion of other st^, especially planners, and advisory council members 
on monitoring visits to subcontractors; regular, routine feedback sessions where 
the data gathered through monitoring is shared with the service deliverers; 
and implementation of a review mechanism to assure tjiat "corrective acti.ons 
have been satisfactorily madejf A strong data base is essential to good ' , • 
monitoring and making intelligent followup decisions that are credible both 
on programmatic and political grounds. 

The involvement of the business sector in prime sponsors* manpower programs 
is of course one of the alms of the new Title VII Private Sfector Initiative 
Program. While the role of business was not a concentrated focus of the- present 
research, we do have good evidence that such involvement can result in good . 
program performance.- Some of the ways prime sponsors can strengthen ties with 
business are by developing systematic contacts with busitiess, of both a formal 
and Informal natiire; keeping abreast, of local employers' plans for hiring, 
firing, occupational needs, and their projections of labor market changes; 
maintaining an active and enijVgetic public relations campaign with the business 
community to make business managers and personnel managers aware of CETA and 
to encourage them to hire CETA graduates through the use of slides, movies, 
speakers, and political offi-cials. 

One concrete way- of involving business (which does not dep^ on PS IP) 
is fov a prime sponsorship* to ask certain businesses to review their training 
programs, to assess their procedures for.piaclng participants in the private 
sector, and to tfell them systematically about their experiences (including problems) 
with'OJT and other CETA programs.- This charge would be clear and. specif ic and 
would ask business representatives for advice in areas they presimably know 
best. A considerable amount of general intelligence of value to the prime 
sponsorship fftaff could be gleaned from developing this kind of informational 
relationship. 9 ' ' " 
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IV. EXEMPLARY APPROACHES TO CRITICAL ELEMENTS OF PLANNING AND MANAGEMENT 



This section moves away from a focus on general patterns found by analysis 
to a focus on concrete examples of different productive approaches to planning 
and management elemenjLs. We intend this to give additional substance to our 
discussion. We have d^rawn not oaly on examples from the 12 planning sites but 
also on selected examples from other prime sponsorships in which we have done 
field work in recent years. This discussion is not intended to suggest that 
there is only *ne "correct" way. to undertake any particular feature of prime 
sponsorship management and planning. However, we feel that presenting brief 
descriptions of approaches that have worked well in specific instances will 
help generate ideas in other prime sponsorships about alterations that might be 
worth trying. ^ 



Seven elements of planning and management will be addressed: 



r; 


Manpower Planning Councils 




2. 


Monitoring and Evaluation 


r 

t 


3. 


Universe of Need and Target Groups 




4. 


Intake and Ass^essment Strategies * 




A. 


Labor Market Analysis 




6. 


• 

System Design: Service Deliverer Selection, 

and Performance Contracting \ 
* * *. 


Service Delivery Systems, 
• 


7. 


Participant Placement Strategies 





In the discussion of each of the seven areas we will use a similar format. 
The key issue concerning the area will be defined and the fidvantages and dis- 
advantages of the approaches will be outlined. We will consider the critical' 
tradeoffs in pursuing apy alternative that we suggest. The general introduction 
will be followed- by a brief description of approaches employed by one hx more 
prime sponsors. 

We dp not view this as a technical assistance guide. ' Suqh/guldes are 
already available;, and prime sponsors would be W£ll advised to read them. 
9ut% detailed "how to" guides tend to suffer f n>m a common limitation: they 
' assume that prime sponsors primarily face technical problems that can be 
-solved With the. application of knowledge. Our research on prime sponsors 
indicates that, the availability of technical knowledge and competence, while 
important, is only one f^^ctor that expla|«is the prime sponsor's approach and 
degree of success with CETA program pla^qining and management. Consequently, 
our discussions attempt to take^ into account the impact of the CETA prime 
"sponsor's environment with its range of organizational and political forces 
that rimpJiige on d|^isions. Our central purpose is to U^lp clatify the^ choices 
that>prlme sponsWra have and* to danonstrate the utility bf various • approaches 
that have been successfully implemented in specific case^. 



A, HANPOWER PLANNING. COUNCILS 



CETA le;glslation and regulations suggest broad. and ambiguous roles for 
manpower planning councils (MFCs), They are supposed to assist prime sponsors In 
planning, evaluation, and Identification of job opportunities. Groups that 
should be included on councils are listed. It Is noted t hat MFC s should be 
advisory to the chief elected officials In the prime sponsorship • 

* 

Given this broad mandate. It comes as no surprise that the role and 
impact of MFCs varies widely throughout the CETA system. Indeed the involve- 
ment of MFCs ranges from near total control of the CETA programs in a few 
prime sponsorships to a mere "on paper'' existence in others. Membership, 
structure, frequency of meetings, and functions performed are also quite 
variable* . * . 

Under certain conditions^ MFCs can be very effective manpower planning 
and evaluation tools, which are most helpful to prime sponsor staffs. Many 
prime sponsors that initially minimized MFC participation have come to realize 
their potential substantive and political utility* This section outlines some 
of the advantages and disadvantages of MFCs and the conditions under which they 
will be most useful. 

Ve have observed MFCs functioning as ^useful and productive organizations In^ 
the following substantive areas: 

• selection of service deliverers, including the review .of RFFs 
and the selection of FSE projects; 

I 

« the ^analysis of Labor Market conditions for selection of train- 
ing components (described in more detail in the section on labor 
market analysis below); and^ 

• monitoring and evaluating operational programs* 

MFCs are generally not as useful in some other areas of CETA program planning 
and management, but may be in some individual clrctmistances • 



Several valuable f|Jficjfe4pns^ that may be performed by MFCs provide further 
justifications for using '^hem* MFCs can be helpful by: 

* providing additional information on factual questions and alterna- 
tive perspectives on how to design and assess manpower programs; 

* lyrovidlng feedback from outside the CETA system on how the program 
is perceived and interpreting the program to various constituencies; 

^ ' ^* -legitimizing tlie decisions of the staff and elected officials and 
acting as a political buffer when particularly difficult choices 
must be made, and; 

* increasing public confidence in CETA ptograms by insuring 
accountability. 

* Naturally, these reasons, which are often cited for using MFCs, are seldom 
disputed* However, there are often instances when planning councils tend to 
work In the opposite and negative direction. Among the problems that we have 
observed with some planning councils are the following: 
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• MFC meetings can be occasions for self-«ervlng log rolls by the 
members to make sure that they get a "piece of the action/' 

• MPC m^nbers can become so involved in the details of the prime 
sponsor's activities that they unnecessarily interfere in what 
should be basic management decisioias~auch as personnel and- 
office reporting responsibilities* 

• A great deal of time may be wasted on inane debates over trivial 
matters* 

• High turnover of MPC members can lead to constant "orientations" 
of new members and revisiting overworked questions by new members. 

How can MFCs be made effective? Under what conditions will they provide, 
productive adjuncts to the overall planning and managoaent capacities of the 
staff?' The basic answer is that the staff must get and keep the right members 
on the MFCs, structure theNCoxmcil effectively to take advantage of their 
skills and limited tlme^ know what decisions they can really help with, and 
provide the information necessary for making those choices. 



Membership of MFCs; Selection. Retention. Proper Use 

Getting the right people on MFCs and keeping them on is the most Important 
condition that must be met if the councils are to be helpful rtther than harmful 
to the prime sponsorship. One generally knows who the "right" people are: 
concerned, dispassionate individuals who represent major public and private 
Interests within the prime sponsorship. But tiowv'does one get these people to 
serve on the MPC? In order to get solid people on the MPC and to retain them on 
it a few conditions must be met. 

First the MFCs must be given substantial responsibilltieff that are clear^. 
cut and meaningful. Busy people (usually the most desirable members) wijl not 
sit still for trivial or perfunctory discussions — at least not on a volunteer 
basis. Staff directors frequently^complain that their council's membership 
"juat'iiAi't interested in CETA programs.'^ This may be true because the members 
see no self-interest in it, or because prime sponsor staff has made the MPC so 
insignificant that only those with generally nothing better to do will continue 
to participate. In other words an iminterested and volatile membership may be 
caused by the prime sponsor staff's poor handling of the council. i 

Second, council members are selected to represent a variety of political 
and substantive interests (such as those of education, business, labor, and 
minorities). The specific person that is chosen to represent each of those 
interests should be chosen with utmost care. They should be selected according 
to their reputation for consistent participation in other groups and for their 
willingness to delve into the council's tasks. Not every member of the council 
has to be a perfect participant, but a critical mass of members who will 
shoulder thVsMllective burden of council/ activities la essential. In selecting 
members for the council, the chief elected officials can play 'an lmportan«role 
by providing information about the general competence of community and civic 
leaders and by giving visibility to their appointment and thus creating an incentive 
for the best potential members to agree to serve. 
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. Third, it is often unwise to put major, service deliverers on the council 
as voting members # A couple of points in this statanent deserve emphasis. Ve 
say *^najor" deliverers because ve do not mean to rule out all recipients of 
CETA services and dollars: in some communities such a stringent rule would 
eliminate practically anyone who the staff would want to involve « But deliverers 
who have large contracts to run programs should be prohibited both from voting on 
all contract decisions and from joining Into discussions of such decisions^ 

The Involvement of. service deliverers at some stage of the council* a 
deliberations is Important* Perhaps a subcouncil of operators should be 
established to work on the day-to^ay probl^kis of coord^iiation and ae^ice 
delivery; but their direct Involvement In selection and evaluation decisions will 
\ all but Insure that the real decisions will not be made in the MFC or should 
not be made there. In fact, the membership of service deliverers on the MFC 
and the subsequent and predictable self-interested strategies that they employ 
is freq\iently the justification for fiot using the MFC in decision-making. Our 
suggestion is to change the menibershlp of the council rather than ignore a poten- 
tially useful part of the manpower systan* 

Council Structure 

The structure of MFCs is important because If done properly it will help 
Improve the retention of gCod MFd members and will take advantage of their 
areas of expertise in a more productive way than If they all meet together 
every session. 

• ■ , / 

MFCs should be subdivided, into working subgroups that allow for the division 
of labor. While the names can vary and to a certain extent the functions will 
overlap » we have found that most councils should have sub-groups working on 
the following identifiable tasks. \^ ^ 

a. Labor market analysis and private sector Involvement (this 
# could be a PIC now) 

b. Monitoring and evaluation of all CETA programs 

4 

c. . Selection of service deliverers 

d. Selection of PSE projects and/or job "slots." 

Each subgroup of the full council should be composed of people who bring 
genuine expertise to the group* They should be aided by appropriate staffers 
from the prime sponsorstiip. The real work of the JfPC should t'ake place In 
these committees and the general norm of the full^H^ouncil, which should meet 
less frequently, should be to defer to the reconmendations of the subgroups. 
The full council* 8 business should be to review the work of the subgroups to 
consider matters of general policy. 

Staff Support for MFCs 

If the MFCs are to be useful, they must be supported by the prime sponsor 
staff. The MFCs principle need from the staff is information provided in )ai 
timely manner. Even the most conmitted volunteer member needs information 
from the staff. The better members will be inquisitive and request additional 
information or may suggest deficiencies in the information provided, but they also 
expect the staff to provide baseline information. 
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It Is not our view that the MFC should have a separate staff working 
exclusively for them. Rather* the MFC should have access to appropriate staff 
meoibers for the specific tasks that they have been assigned. There should 
be one senior person on the CETA staff that handles the general direction of 
MFC Input, but separate staff Is not necessary and could well product new 
problems that are unnecessary and unwarranted. 

« In ahorty MFCs can perform several Important tasks and functions for 
CETA pla^ning and management If the several condition^ mentioned above are 
fulfilled; MFCs must be composed of the right menbers and those members must 
stay on the council, ^ey must be structured effectively to take advantage 
'of" lU» ^uember ' s expertise, and the staff support for the council deliberations 
must be provided. Councils should not be run by the staff nor .run the staff , 
but they do have a useful role to play In the CETA system. 

Some Exam|)les 

" Three excellent examples of planning council participation will be described 
below: San Francisco, Atlanta, and Penobscot Consortium. Baltimore's creative 
use of Labor Market advisory councils Is discussed In the Labor Market Analysis 
section of the report. 

San Francl»co> California . The San Francisco CETA program Is administered 
by the Mayor's jOfflce of Employment and Training. Declsion-inaking patterns in 
the San Francisco CETA program reflect the lo<:al norm in city government that 
encourages public participation. Neighborhood based agencies in the city are 
highly politicffi^y sophisticated. The base Title I allocation is about $8 
million. 

fje Manpower Planning Council (MFC) Members that are appointed by the 
Mayor represent numerous constituencies — ethnic, racial, and geographic. 
While all MPC members have not been equally dedicated , the council as a whole 
can be characterized as aggressive and knowledgeable about CETA. The council 
is chaired officially by the Mayor, but the alternate chairman, who always 
presides as a senior member of the Mayor's staff. The CETA planning staff 
provides support for the council. 

The San Francisco MPC vigorously reacts to, debatei^^nd Initiates 
planning recoinmenclatlons and decisions In several areas? or responsibility: 
program design , evaluation of RFP proposals ,' and evaluation of subcontractor 
^performance > ® 

The program design details into which the council has major input include: 
1 i) the percentage of funds allocated to each Title I program activity, such 
as classroom training, OJT, and so on; 2) the Identification of special target 
groups and the percentage service goals for each group; and 3) the establishment 
of overall performance standards for the manpower delivery system, including 
number served, placement rates, arid cost per placement. 

The MPC also reviews and evaluates responses from potential contractors 
to staff requests for proposals. They play a major role In selecting the 
subcontractors vdiose mix of proposed services > budget, and target groups will 
'fit the specifications of the overall |)rogram design. 
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* Note that this discussion focuses on the San Francisco MPC before' a very 
recent reconstltutlon of it. 

* 
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The MPC^s liKost Ixfiportant task Is Its evaluation of subcontractors* The 
semi-annual evaluations are connected with the evaluation of RFP responses. 
Staff monitors who are assigned to eaich subcontractor write operations 
overviews that Incorporate their personal observations ^ MIS reports, program 
plans, and , other program data. The monitor also completes a standard 
Monitor's Review form that details program activ^.tles. Finally, each subcontrac- 
tor prepares a self --evaluation report. All of these docments discussing the 
programmatic, fiscal, and administrative activities of the subcontractor are 
submdtted to the MFC. The council holds public hearings on program performance 
and Identifies problems in subcontractor performance for staff follow^ip. 
The results of the evaluations are used extensively in refunding decisions. 
^. . ' ^ 

Atlanta, Georgia > The Atlanta CETA program is administratively located 
in the clty*s Departm^t of Coomunity and Human Development, but the Director 
of CETA reports directly to the M^yor. An outstanding feature of the prime 
sponsorship, whose Title I program is now about $5- million, is its openness 
in CETA decision-fsiaklng. The primary vehicle to achieve this is the 35-«ember 
Employment and Training Advisory Council (ETAC). iTwenty-nine members of th^ 
ETAC are appointed by tjiie Mayor upon recoim&endati<^ from the staff and with 
the concurrence of the city council.. The remainiipg six members are appointed 
directly by the city council with the approval of I the Mayor. The only city * 
employee that may serve as an ETAC member is the Pirector of the 3ureau of 

Personnel. New members are given a one-day. orientation by CETA staff. 

• j 

The ETAC considers and Influences decisions [regarding the selection of 
target groups and occupations, program mix, and, joost Importantly, service 
deliverers. The ETAC Is very active and Its by-laws provide for dismissal , 

. from It If "a member falls to attend, two-thirds o4 the monthly meetings over * 
a six-month period. A one-week notice and an ag^oda Is required before an 

vpITAC meeting can be held. Notices of meetings are published In local 
newspapers . ' * ! . _ 

* Since virtually §ill major Title I functlon^are subcontracted in Atlanta 
the procesa of annual selection of service, deliverers Is a most lmi>ortant one. 
It begins when the staff distributes Requests for Quotations for desired 
services. The KPQS specifying detailed progrma requirements are widely distri- 
buted to a! bidder's list and advertised In major newspapers. 

Funding recommendations are prepared in subcommittees of the ETAC, which 
are constituted to ensure freedom from conflict of interest. Using formal 
ratings, the sutrcoomitt^s award each proposal points in areas of demonstrated 
effectiven^s (such as placement success), professional qual if lea t ions, * planned 
performance standards, cost^ffectlveness, and supportive services and facilities. 
The Individual proposals are ranked in comparison with one another and submitted,^ 
along with a reconaendation, to the full council. Subcommittee rankings are 
generall]^ accepted by the full body, and reconciled into an overall package 
during a meeting with the staff. The staff departs from the session with the 
MPC with a priority designation on each proposal being either a "must fund," 
a "fund if possible," or a "don't fund." 

There seems to be 4 genuine give-and-take betwe^ the council and the 
staff. While the staff has ample opportunity to try to sway the decisions 
of the. council, they tend to limit their influence to those issues dixsgctly 
related to the performance and survival of the system as they view It. 
Not the least among their motives is the recognition that, the ETAC is a 
valuable buffer between them and disgruntled bidders, but Would soon cease 
playing that role if it began to be perceived as a rubber stamp manipulated . 
by the staff. ' - 
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Penobscot Consortium, Maine . The Penobscot Consortium Training and 
Employment Admlnlatratlon operates under the jurisdiction of a Consortium 
executive board, which is composed of the six. county cqmalssloners from Penobscot 
and Hancock Counties. Not nearly as large as the first two prime sponsors 
discussed above, the consortium's Title I allocation is slightly over $1 million. 

There are two advisory councils: one serves Penobscot County; the other 
serves Hancock County. Menbers come from a broad range of backgrounds — 
^S, vocational schools, conmunlty colleges and universities, social .service 
agencies, community based organizations, business, labor, and participants. 
Membership has been stable and both the staff and the council agree that the 
council is knowledgeable about CETA programs. Some council members represent 
agencies that have submitted proposals for PSE positions, but the council is - 
not dominated by groups that are singularly Interested in securing CETA funds 
for their agency or group. 

While the County Commissioners appoint the council chairs, and often 
attend council meetings, they rarely participate actively, and in no wdy 
dominate council proceedings . The entire council meets monthly and sub- 
connittees at least one additional time each month. The councils* three 
subcommittees handle Title VI project proposals, new programs, and monitoring 
and evaluation. Its most important role has been in Title VI project selection. 

An ideal opportunity for the staff to foster citizen particlpationi came 
in the form of the Title VI project funding decisions because the staff recog- 
nlzed the great potential for conflict and outside pressure. Agencies 
throt^hout the consortium area were Invited to submit project proposals for Title 
VI fWdlng. These proposals were collected by the staff and, after ajvery 
brief review, passed along to the subcommittees of the advlspry councils. 
SiAcoraaittec members spent loAg hours formulating project funding recommendations 
^e subconmlttees established their own funding criteria and evaluated the 
proposals themselves. They also held public hearings so that project advocates 
could offer further support for their proposals. During this process, staff 
support was available, but the councils and the subcommittees' were the key 
actors. The final council recommendations were well received by the staff 
and the county commissioners and faithfully implemented. 



B. MONITORING AND EVALUATION . . 

Monitoring and evaluation are Important components of management and 
planning in a CETA prime sponsorship — a statement -with which few wotil^. disagree^ 
In the abstract. Problems enter in when prime sponsors 'debate h'ow much resources 
should be devoted to monitoring and evaluation and the purposes that should be 
accomplished with the monitoring and evaluation effort. This section of the 
report will discuss the use and misuse of monitoring and ^valuation and how to 
mount relatively simple and inexpensive approaches that are none'thelesb quite 
effective. ^ 

• * 

Monitoring and. evaluation are related, fut different, enterprises. 
Monitoring focuses on operational questions— keeping track of the system. It 
should be "present" oriented and provide feedback inmiediately into the 
system. Evaluation, on the other hand, examfnes the impact of a particular 
program component. Such questions as placement rates, cost-per-placement , ^ 
wages obtained , and length of employment of those pj.aced form the heart of v , : 
evaluations. Almost all prime sponsors conduct some sort of monitoring. 
Only a minor;lty undertake evaluations. ' * . * ' ^ 
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It Is important to point out that In ord'er to conduct effective monitoring 
<and evaluation a reliable management Information system must be established. 
Without Information on the performance of the programs that has been systema- 
tically collected by the prime aponsor staffs It Is virtually impossible to 
conduct useful evaluations. The MIS has to be designed not only to fulfill 
minimum federal reporting responsibilities » btit also to provide Information that 
will allow s^lor staff to answer the kinds ot evaluative quest I6ns In which 
they are Interested. ^ A thorough discussion of MIS is beyond the scope of 
this report » but it is essential to "design^an MIS with questions of ^monitoring 
and evaluation .In mind.' ^ 

f * 
The Use and Misuse of Monitoring and Evaluation , * 

A fundamental distinction that must be made in evaluation Is whether 
a program is already in operation or whether consideration Is being given to 
starting a program. 'The analysis required for making good decisions about 
which program to operate are very different from the reqtilranen^ts for evaluating 
programs that are already operational. Vie will focus on evaluating prograna 
that are already in operation^ In such cases the Interest is more upon the 
Improvement of services rather than upon evaluating whether or not a service 
is worth keeping. In ptHer wordb, most prime sponsors are probably going to 
continue to operate vocational training » work experience » public service ^^S^ 
employment, and OJT programs, ^he key questions are "How can our programs 
be made better?** **How much money should we spend on each one?*^ and, **Whlch 
agency can best, deliver the service?*^ ^ * » 

In order to find out how to improve programs jthe prime sponsor stBtT must 
monitor them on a regular- systematic basls^ and then pull together that ^ 
Information to determine iporrectlve action and teclinlcal assistance. ^ 

Monitoring and evalu£)tlon can serve several functions: 

^ !• provide regular feedback on th^ operation of programs, agencies, . 

and personnel* ^ . - • 

2. determlTie the natut^e of corrective action to Improve programs, Includ^lng 
te)nplnatlon' if necessaty, but, more typically, chaivges in their design, and/or ^ 
the approach of personnel. * C 

3. / help clarify a,nd re-examine the objectives and underlying assumptions 
of the programs. 

4. develop more critical attitude among prime sponsor and subcontracting 
agency personnel, which should include opportunities ,fbr them to suggest ways 

of Improving services. ^ ' \ - , 

5. Increase staff morale and commitment as a^bonseqlience of the attempts ^ 
to jGq^i^rove the pjwgram. , « 

There* are also a nimiberr of what JBdward Suchman (197Ck) jiias labeled as 
**p8eudo-evaluations. **. We have observed Instances of Suchman^s five' categories 
of such speclmis enterprises;^ ^ - - ^ - 

1. Eye-wash — an attempt to Justify a weak ot bad program by^ 



^deliberately selecting for evaluation only those aspects' 
that **loo^ good** on |th6 surface. Appeatance re^^ laces reality < 
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2. fnilte<^a8h — an attempt to cover up program falltore or 
errori by avoiding any objective appraisal. Vlndlca-, 
tlon replaces verification. . 
3I Submarine — an attempt to "torpedo" or destroy a program 
* regardless of Its effectiveness. Politics replaces 

.science* 

4;i Posture — aJk attempt to use evaluation as a "gesture" of ^ 
objectivity or professionalism. Ritual replaces research. 

5. Postponement — an attempt, .to delay needed action by 
pretending to seek the "facts.". Research replaces 
service. . * 

Doing Monltoylng and Evaluation: How Difficult- Are They To Do? 

» # 

Perhaps mdre troublesome than any of the "pseudo-evaliiatlons" Is the 
widespread absence of evaluations. The reluctance to get Into the eval- 
' ' nation ''business''' has Its roots In a number of apprehensions and misconcep- 
tions about program divaluatl^. . . 

One frequently heard lamenj:^ is "we can't do evaluations, because no 
: one here has statistical training and even if some did the rest of us couldn't 
understand them." In most cases sophisticated evaluations, with elal^^rate 
quantitative manlpxflatlona ^d methodology, are unnecessary. Most prime 
sponsors need practical pi^ogram evaluations that will help Improve the 
delivery, of services and the basis for choosing among alternative program 
' mixes and service deliveretSi In such evaluations, the most difficult calcula 
tions are no more complicated than balancing a checkbook and can be done on a 
desk calculator. Evaluations can be conducted by staff with little or no 
training in evaluation research if some straightforward principles of logic 
are followed. 

- ■ , ~ • 

The examples cited^' below demonstratia ar range of approaches to monitoring 
and evaluation from the Simple .to th*^ complex. Some prime sponsors look ^t 
a few performance measures 'and conduct qualitative reviews of subcontractor 
performance . . Others collect fuad analyze mbuntains of Information on .the 
economic and non-economic Impacts' of CETA programs on participants. The 
extent of monitoring and evaluation conducted by any given prime sponsorship 
' should hlng^ on the general availability of staff >nd resources to conduct . 
them. Low- cost evaluations that yield very useful Information have been 
devised and successfully employed. Moreover, as noted in the dispussion of 
manpower planning councils, it is possible- to make use of volunteer help in 
conducting monitoring visits .and evaluations. The nature of the evaluation 
effort should also be linked to the siSe of the progrfdn. Smaller prime 
sponsors may not be able to afford (or justify) large scale evaluations and 
should lean toward the simplest 'and least expensive approaches available. 
Ilarger prime sponsors may be able to afford more' complex and systematic* eval- 
uations and the stakes of their prpgrams justify larger expenditures of staff 
time and resources. v 

. Some Examples ^ - ' 

' * » • • '. 

The examples in the section be],bw discuss some useful approaches to 
evaluation that have been cdpductjad in the prime sponsorships we visited. 
We hope that they will help deflate the myth, that evaluations are, too 
difficult, too dostly-, or a waste of time. In fact, we think they clearly 
demonstrate the utility of. systematic attempts to find out "^at works."- 
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Bergen County, Neir Jersey > The Bergen County CETA program is operated 
by the Community Action Program. Most^f the $5*5 million Title I program, 
with the exception of training courses » is operated by the agency* Although 
Bergen County does not hsve a sophisticated or heavily staffed monitoring ^ , 
and evaluation unit/ they nevertheless successfully empldy a number of useful 
approaches to finding out ^at works and how to Improvejlt. 

Most of the monitoring is'donff^l^y the planning unit's senior planner for 
monitoring and evaluation (M&E) and his two assistants. The overall purpose , 
of their monitbring is to assess the performance of the In-faouse units 
and the subcontractors in relation, to the' plan. At l&sl^ once a year 
all components of the CETA program are monitored: the Vocational Center' 
(run by a local school board) » Adult Learning Center (run by a community 
college) t and OJT, Work &cperience, and multi-*service centers (run by the GAP). " 
As special needs (or problems) arise additional monrtoring studies are 
J conducted. < « 

The M&E unit focuses on client satisfaction with employment and training * 
services^ All CETA participants are mailed a brief questionnaire -with a 
standard set of questions on how they got into the program, what they gained 
from it/ what happened to them after participation , and so on. Re^sults are 
. analyzed and sxmmiarized for the senior staff, the operations stafft and the 
staff of the subcont;:^ting. Agencies. Each report Includes reconmendatlons 
for Improvements ' tQ correct deficiencies uncovered by the poll of enrollees. 

Parts of the review of agency and subcontractor performance consist of 
on-site visitations, interviews with the staff t and desk reviews of agency or 
component pferformance. Subcontractors are required to submit monthly reports. 
The vocational training program, 'run by an outside agency, and |:he OJT program, 
run by CAP, receive the most attention from the monitoring staff* 

The most interesting aspect of the planning unites monitoring is their 
work on the OJT program. One staff member is assigned solely to this task: 
he completes a detailed analysis of each OJT contractor's performance. 
Each contractor and participant is Interviewed by the monitor. On the basis 
of these interviews, a corrective action report is prepared as necessary, 
submitted to the contractor, and followed -up by the same staff member. Criteria 
for assessing OJT contractor performance are the extent to 'which the employer 
provides the training, specified in the contract and hires people that they 
would not have hired otherwise. The monitoring has had concrete results, 
allowing the staff gradually to reduce the length of training Jfor most OJT 
contracts, thus freeing additional resources. 

A different type of monitoring is done by the prime sponsor ^s advisory 
council, known as the ETAC. Members' df the committee are given the results 
of the monitoring reports, but they also make on*^site visits to the multi- 
service centers, and to the major subcontractors* The ETAC is given credit 
for pushing the SMffl^d Che subcontractors to improve performance, parti- 
cularly in the OJT area. ETAC reviews are conducted iiv advance of decisions 
about 'the TltlVl plan. 

Monitoring is also done by the operations unit chief. While the planning 
unit examlnesy achievement of planned levels of performance, the operations 
director is more interested in day to day problems. Consequently, he* inves- 
tigates such qnestions as: Are the? multi-service centers ptoperly completing 
the eoiployablllty d^elopment plans? What is the nonpositive termination rate 
for each center? EaMv counselor? Why?^ In oi^er to answer these questions, 
the operations tidirect^T holds regular meetings, with the multl-servicp center 
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directors an4 their staffs » makes unannounced visits > and most Interestingly, 
sends bogus clients through^ the system who report back to him about their 
treatment at the centers* 

The various approaches to monitoring have an Important Impact on the CETA 
program^* The staff vj^ews their approach to monitoring as "looking for 
trends." There are no formal outcome evaluations , 'rather , the staff views, 
evaluation as the susmary of the monitoring efforts. The staff recognizes, 
the value of more formal evaluations, but has not conducted any because their 
MIS ftas never really provided them with the kind of data that would be required 
to^ perform them. 

' r 

• - F 

The Bergen example illustrates that useful monitoring can, be accomplished 
with a limited investment of staff resources, and with limited sophistication 
about evaluation methodology and statistics. The effect of the monitoring 
activities was summarized by a senior staff member: "it has been instrumental ^ 
in building a level of accomplishment. Over time, we have used the reports 
to gain an Increasingly objective sense of our program." \ 

Penobscot Consortium, Maine , Like the Bergen County programs, Penobscot s 
monitoring system is relatively simple. Weekly, monthly, and quarterly reports 
prepared hy the MIS unit are used by both tl&e planning and operations units * 
to ^heck on client flow, expenditures, target group service, and so on. 
Full-time monitors make visits on a regular basis to training, work ^experience , 
CkJT, and PSE sites. Findings from the visits are compiled by the MIS unAt axid 
circulated to the senior staff so that necessary changes can be made immediately. 
The^ea Operations Director also engages^ in personal monitoring. Monl-' 
toring is viewed as a means of keeping abreast of short term trends In 
the program. Planning staff are intereste^^ in the relationship beti^een planning 
projections and\)erformance; operations people want to know how the different-^ 
Offices of Training and Employment? Programs are performing and even how the 
individual job developers and counselors are performing. ^ 

Unlike Bergen County, Penobscot coni|ucts evaluations focusing on longer 
term trends and tests basic questions about whether a program or service 
produces the expected results. Short tetm evaluations may examine questions 
related to thp monitoring concerns. For example, last year th^y examined 
the relationship between enrollment, termination, and placemeht^of various 
demographic groups in order to -reacAi some judgments about the equity of service 
in the program. Another short term study looked at the relationship between the 
applicanf pool*, those referred, and those enrollred in STIP. This study showed 
that those enrolled were 'more representative of the applicant/ pool than 
those referred, suggesting that referrals were made on the b^sls of Incorrect 
assumptions about the kindfe of people best suited "for the program^ This was 
passed on to the operations staff and changes were made. 

The longer term evaluations are baaed on surveys administered to all 
Title I participants and a sample of PSE enrollees at regular Intervals after 
they terminate from the prograi*-- 30, 60, 90, and 180 days; afhd^, 2, 3, and 
4 years. The surveys probe 'numerous social and economic effects of the 
program. Control groups will be developed from among those. who applied and 
were eligible for the program but did not participate. 

The impact of the monitoring activities is substantial. The operations 
staff is anxious to get monitoring reports and use them to identify and 
treat operational problems. The repSbrts also prombte continuous and 
constructive exchanges between the planning and operational units of the 




agency. The results of the longer tern evaluation studies arei Just beginning 
to become- available, since the system was set up only a year /ago » But, the 
senior staff are committed to using the re^uXtp of the evaliiations to make 
changes, even if they are major ones. / 



Baltimore Metropolitan Manpower Consortium^ Maryland . The Baltimore 
Consortium cd^sists of the City of Baltimore and the five contiguous counties 
in the SMSA.yThe Mayor's Office of Manpower Resources is the administrative 
. arm of the^^^n9artium. With a base Title I allocation of over ^15 million and 
'a total budget of nearly $70 million, it is clear that the agei^cy can afford 
and in fact needs a large evaluation staff. The Research and Evaluation Unit 
q^bne has 10 employees , but many more people are involved in monitoring and 
evaluation. 

The Baltimore Consortium makes the standard distinction b&tween monitpring 
/and evaluation*:* As with Bergen County and Penobscot consortium, monitoring^ 
involves short^ term assessments of the progress of subcontractors toward ^ n 
meeting their contractual goals. Evaluation examines the Impact of CETA 
services on participants and the community. Monitoring is done by nine program 
analysts who worK in the Grants Management unit. They visit the programs to 
which ^they are assigned at least once a week to check payroll, attendance, 
and classroom activity, keeping inforioial records and making a monthly report to 
the Director. The monitors play botl) oversight and te^shnical assistance rf'oles* 
Much of their time 4^ -spent on maintaining an. efficient and accurate ^MIS 
because it generates weekly reports 'on ttie performance of the agencies. 

The evaluation staff is divided Into teams that Evaluate short and long- 
range impact of CETA programs. The teams are^ivided as follows: manpower 
service center evaluations, youth programs, training components, work 
experience And PSeT and follow-up^fot surveys of participants six months after 
termination. The members of the evaluation staff report directly to the 
Deputy Director and.have^no operational responsibilities. Each team, which 
is made up of people with program experience add sos^ methodological training, 
establish an agenda Sn consultation with the program monitolrs and the senior 
• staff. - • ^ 

* Short term evaluations examine the types of clients served by programs, 
seprice deliverers, and Jurisdictions, or the placement rates by similar 
categories. They also analyze relative costs and*co|duct surveys of various 
kinds, including employer reactions to manpower traiiyses. Long term 
evaluations Include surveys of program completers afti||^ six months, for ^ 
example. In short, the evaluation unit undertakes a series of operationally 
oriented and long-term projects that aid the Senior, staff in making concrete 
decisions, but their work can also help develop knowledge* about the efficacy 
of various manpower approaches^ 

^A review of the recent agendas of the evaluation teams highlights the 
nature of their work. The follow-up unit planned a long range survey on 
employment retention and other prograiomatlc issues for the Susmer You}:h Program, 
the work experience programs, OJT, and pre-apprenticesttlp\trainlng. Tbe 
manpower service center evaluation team planned a demographic analysis of the 
Intake system, a geographic analysis of registratioi^, service, and placement 
by census tract, and the development of a formula £or calculating the rough 
dollar value of all services delivered to each census tract in the city. The 
training evaluation team planned to analyze "program hopping." As part of 
their normal responsibilities they also conducted exit interviews and tests 
for the LPN and clerical training programs. ^ 
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Both the progi^al^ monitoring and the evaluation work are used extensively 
by the senior staff for management decisions and for planning the mix of 
manpower services, the selection of service deliverers, and for contract 
negotiations. Unlike some prime sponsorships, the staff has not sought to 
-make the results of theli: evaluations public, but they do use them In their 
discussions with the agencies, and the service deliverers undoubtedly know 
that the 'staff could always make th«a public If they wanted to. Thus, we 
found that most service deliverers were content to live with the findings from 
the evaluations; they did not question their Integrity, but a few did have doubts 
about the accuracy and tlmellndas of the MIS on which the evaluation reports 
are based. 

Suianary • " . 

The three examples of prime sponsor monitoring and evaluation^ activities 
provide excellent evidence of the range of approaches used In CETA and 
Illustrate some Important themes. On one end of the continuum we have Bergen 
County's approach—a small staff, limited quantitative jiata, a relatively 
weak MIS, use of volunteers on the MFC, emphasis on operational questions. 
On the other/end, we have Baltimore Consortium — a large evaluation and 
monitoring staff, extensive quantitative analysis of sophisticated MIS data, 
limited public involvement, emphasis on operational and long range questions. 
Yet, all three prime sponsorships reap significant benefits from their moni- 
toring and evaluation. All of them use the results in contract negotiations 
with service deliverers, to correct their operational problems, and to chart 
future directions for program expenditures. The particular approach 
chosen by a particular prime sponsor will depend on the overall size and 
complexity of the prime sponsorship, the political climate of subcontractors 
and interest groups, and the skills of the manpower staff. The experience 
of these prime sponsorships demonstrates the value of Imaginative solutions 
to monitoring- and evaluation. • 



C. tJNIVERSE OF NEED AND TARGET GROUPS 

In nearly all CETA programs in most coinmnit'les there are far more 
people eligible for CETA than can be served by the program. This suggests that 
needy segments of the population must be identified, their size and characteristics 
estimated, and appropriate- levels of service specified. CETA planners who 
are assigned the task of ^ analyzing the "universe of. need" face difficult probicms 
that can be grouped into four somewhat overlapping categories: definitional, 
technical, evaluative, and practical. Each category poses a different kind of 
difficulty for prime sponsor staff. They will be briefly described below and^ 
approaches to coping with them, drawn from our research In several prime 
sponsorships, will then be presented. , 

The first problem facing CETA planners doing a needs analysis is • 
definitional: how should target groups be defined? The possible criteria are 
numerous: age, race, incoiae, sex, geographic location, duration of unemploy- 
ment, work history, education, and so on. Target groups can be very broad 
categories, such as youth, heads of household, minorities,, oj: narrow ones, 
such as "black female heads of household with two or mofe dependents." 

. CETA legislation originally provided very minimal direction, and even 
in its latest revisions is only somewhat more specific about who to serve. 
Then^w emphasis is obviously on the long-term unaoaployed and the disadvantaged, 
but It is still not possible to serve all of them. In order to make sensible 



recommendations to senior staff, political officials, pr planning counj^ll 
members who might participate In the selection of target groups, planners need 
to'lcnov the size and characteristics of the eligible population and where it 
is located in the V^^^ sponsorship, at a minlmimi. Answering those questions 
can be very dlfflc5u.lt, however; 

The second problem Is evaluative. Beyond the base-line eligibility, prime 
sponsors should target their limited resources on those^who can most benefit 
^from the types of employment and training programs that they have available. 
This requires nareful attention to the assumptions underlying one's manpower 
programs* Target group selection, therefore, is a choice in m'&npower planning 
that, likiB so many others, cannot be made in Isolation. 

Assuming that the prime sponsorship can reach agreement about how target 
groups should be defined, one must decide which groups will receive highest* 
priority. In our view, the staff should place goals or quotas oji particular 
groups and implement those decisions through the intake process and by designing 
programs that will meet the , needs of the priority groups. If this is. not done, 
then those enrolled may not be the ones that were *HnoBt in ^eed," according to 
the prime sponsor's definition, nor the set of people yho could beat take 
advantage of the CETA programs in the prime sponsor's Jurisdiction. ^ 

Unfortunately, the debate overjtarget group priorities is often conducted 
without reference to the evaluative issues and the data. Individuals and* • 
groups within and outside the prime sponsbxship press claims for. more service^ 
to their preferred group. Prime sponsor st^f frequently are unable to respond 
to these claims effectively because they hav<( little or no infomation on the 
size and needs of the groups ^eing advanced. 

Determination about target group priorities should not be made solely by 
a^ competition of iiaterest groups, though responsible political officials and > 
staff members must ultimately make va^ue judgments. Instead, such a debate should 
be informed by a careful analysis of the actual need of particular groups, w 
broken down, not Just by their ascriptive characteristics, but hy theix need for * 
different kinds of manpower services. 

j: The third ,kind of prpblean is technical: how can prime sponsor staff maka- 
careful analysis unless they have adequate data on the universe of need? C!^TA 
pranhers are frequently frustrated in their attempts to obtain data that ^ill 
allow them to analyze need for manpower programs in their prime sppnsoi^sfiip. 
iJnfortunately, the 4ata collection system of the U.S. Employment Service was 
not designea with the needs of 'CETA manpower planners in mind. Even though 
prime sponsor staff universely acknowledge that their data are Imperfect, 
some have been able to reach more accurate descriptions of need than o^ers. 
A point addressed in some of the examples below is. how one can Improve the 
quality of data within the limited resources of the prime sponsorship. 

The last type of problem is basically a practical one. CETA planners 
recognize that the goal of good target group planning Is to help improve the 
quality of prograita operations and to assert the preferences of CETA decision- 
makers about whp should benefit from CETA programs in a way that corresponds 
to a measure of local necffi. « * 

Elaborate needs analysis can be a waste of time and money If the results ' 
are not taken serlotisly by thoee operating the programs. Planners must take ^ 
Into account the limitations Imposed by the types of CETA services that their 
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prlne sponsorship Is equipped and/or willing to provide, the history of past 
program performance with a partlrailar client group , overall labor market 
conditions, and aaployer expectations. - 

At the samfe time It Is Importanlt not to let operational considerations 
dominate the planning i(>rocess entirely. A balance between operational goals 
and goals for serving priority groups must be strr^ck. 

Some Examples ' t * 

Denver. Colorado . The Denver CETA planning system does a particularly 
good -job pf handling the definitional and evaluative aspetets of universe of 
need and target groups analysis; Their methodology was d^eloped In 1976 
for the FY '77 plan and used again for the FY '78 plan. /It^ is based on a 
matrfx that uses both population characteristics (ethny: group, age, sex, 
veteran status, and head of household status) and 8Ocl0-econoiBlc Indicators 
(percent of pppulatlon, percent of labor force, unemployment rate, percent of 
group In poverty , and percent of applications at the Employment .Service . ) 
The economic l^fllcators are assigned differing weights based on the Judgment 
' . of the staff Injlolved In planning (and ratified by the MFC). Indices of 

relative nea*<?re then derived for each population group. A second matrix Is 
then creajted that cross-tabulates ethnic-sex groups with veteran^ age and 
head of household status and subjective judgments ane made about how to weight 
> the frequencies. * , 

The Index of n^eed and the frequency Index are combined to provide a 
single Indet. The twenty-five neediest, groups were singled out as those 
about ^Ich decisions had to be made In terms of relative emphasis. The 
number of people In each of the twenty-five groups In poverty were calculated. 

The matrix method developed In Denver Is not ^Ithot^^ Its problems. It 
• /' uses 1970 Census data, which are particularly obsolete In Denver beqause of ' 
Its great growt^i In the 1970s. The staff plans to use more up-to-date. data 
from the .Baployment Service on the characteristic? of Its registrants In 1977 
for the next plan, but some people will not accept ES.data because they claim 
that the poor are reluctant to register there. Finally, many of the critical 
decisions about who gets served are still subjective. But, overall Denver 
has constructed a useful method for systematically examining Its universe of 
nee^. 

Penobscot Consortium ^ Maine . Penobscot Consortium has don^ k particularly 
noteworthy job In supplementing the standard forms of quantitative data on 
universe of need with qualitative Information, and In making good use of the 
quantitative data that they do have available; Wishing to avoid narrow target 
group designations, the staff has Identified significant segments as the 
economically, disadvantaged, youth, women, older workers, veterans, and natlye 
Americans. But Chey go beyond merely naming groups that should be served. 
The staff also conducts an exhaustive search of all available quantitative 
Information In orddr to develop goals for aervlce to eacb^group in propoirtion 
to Its representation In the universe of need. Other groups that do not loom 
large In such an analysis nevertheless re'celve high priority: migrant workers, 
offenders, 'handicapped persons, and alcoholics. 

The final goals for target group service are not based solely on the 
quantitative data. Qualitative assessment by the staff and advisory council 
members also plays an Important role. The council considers the question of 
target group selection in some detail each year. For the most part, their 
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Input does not result ^^^r^at changes In the staff research. However » they 
do oifer suggest lons^^tfiat clarify and jmbdify staff findings In productive 
ways. ^ • 

San Francisco > California . ' The San Francisco CETA- program's approach 
to target group planning Is Impressive f^ two reasons. First, they vigorously 
attempt to «erve people In their community In proportion to their presence In 
the unemployed- population . Second, they are willing ta design new programs to 
meet the ne^ds of their clients rather than let the current mix of services 
dictate thc'^ kinds of people they can servq. The analysis of the unemployed 
population Is relatively simple » the follow- through Is* unusual. 

The universe of need In San Francisco Is very complex: there are many ethnic 
groupings, many language problems, and so on. Each- year the staff .analyzes 
the demographic characteristics of the unemployed population In the city. 
The findings are used In designing programs and In choosing service deliverers. 
Becai^se San Francisco Is so diverse, they have funded a large number of Title I 
programs-^over 30 In FY' 78 — to serve the many groups Identified 'as l>elng In 
need of manpower services. Each subcontractor Is given specific standards 
about the characteristics of those that they must enroll In the program, and 
they are closely monitored by the staff. 

Unlike most prime sponsorships that work with a stable group of programs, 
services, and target groups from year yto year, San Francisco's CETA staff has „ 
demonstrated a willingness to reach out for new organizations to deal with 
nevly discovered or defined problems. There seems to be no significant 
barrier to employment that the staff Is unable or unwilling to address. 
If the^tuff discovers that a program cannot deal with a specific problem, > 
they will create a new program or establish linkages with other agencies that 
can assist In Its solution. ^ 



D. INTAKE AND ASSESSMENT STRATEGIES 

The previous section discussed metTiods for Identifying, evaluating and 
establishing goals for service to target groups. In order to Implement target 
group goals. It Is necessary to establish a method for determining who gets 
Into CETA programs and who doesn't (Intake), and a method for channeling people 
Into the "right" services or' programs once they have been admlt^ted to the , - 
CETA system (assessment). These two functions, which serve as the entry 
points Into CETA, are clearly Important determinants of what the System 
produces, whether the staff pays attention to them or i\pt. This section 
addresses some of the* central questions Involved in developing effective Intake 
and assessment strategies. * ^ 

There Is an lnesca:pable tension built Into CETA programs that Is resolved 
In one way or another at the point of Intake and assessment. The baseline 
rationale for employment and^^lnlng ^programs Is that they provide services 
that enable certain people to^btaln stable employment who would be unable to 
do so without some kind of Interference In their ability to cope with the 
notmal functioning of the l^bor market. Therefore, client need should be the 
primary determinant of whether someone receives CETA serviced. On the other 
hand, program administrators stress^that CETA can only do so much to change or 
shape the employablllty of the people It serves » and these limitations must 
be recognized. This suggests that some particularly "needy" people may not 
be serviceable from the point of view of CETA. Thus, need aflone cannot 
determine client selection. The problem is that it is easy to slip into the 
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practice of "creaming" once need becomes only a^ factor in selection rather 
than the factor. ^ * - 

The way in which most CETA programs are planned,^)implemented, and 
evaluated encourages creaming. Typically » planning periods are short, limned ia p e - 
evidence of results is dema|ided, and evaluations are based largely on positive 
termination rates and placement ratea^. The closer the clients 'are to job readiness, 
the easier it is to get a program off the ground, and to produce results that 
look good (at least If one doesn't look too hard H Thus, the Incentives to 
cream the best participants from the applicant pool are considerable (program 
operators want capable people, DOL and elected officials want to ^ee results, 
and so on^ and the limitations of the programs are real. The intake^ system 
must somehow uphold the Integrity of the CETA system by bringing in people 
who need help, and yet stilL contribute to the ef f icient^,joperation of the 
programs. Our' reseai^h has discovered many elaborate desl^s for achieving 
this goal, but few Instances In which the designs were actually Implemented. 

One means for making some headway in the search for an intake system ' 
that is both responsible and effective Is to assert that program participants 
should reflect the priorities established In the analysis of the local universe 
of need. The desirability of linking client Intake decisions to analyses of 
local need is generally recognized among CETA adminlatrators , but again, seldom 
done well.** Designing and Implementing an effective Intake system introduces 
some difficult problems that go' far beyond this simple recognition. Many 
prime sponsors base service levels either wholly or partly^^^m past levels of 
service to specific target groups. This -practice obviously introduces a 
great deal of circularity in the re^lationship between target group planning 
and participant service, which is tidy, biit hardly justifiable. In some cases 
this practice is followed to reduce uncertainly, especially^with regard to 
meeting standards set by national ind regional offices of DOL. In other. caSes 
this practice C9mes about because service levels for different target groups 
have emerged after ^ears of political compromises among local clientele < 
groups that cannot be changed easily. 

• / 

^ A second problem that must be dealt with Is whether to Impose strict 
service <iuotas on those responsible for Intake in order to achieve the 
desired mix of clients, or to leave some flexibility in the intake system. - ^ 

In the course of our res€farch we have found that prime 'sponsor intake systems 
show a wide range of variation on this score, from those who admit applicants 
randomly (usually after eligibility determinations), to those in which heavy 
controls are Imposed on the intake system. , 

It is aTpparent that the two problems discussed above are related. If 
next year's service goals are determined by last year's levels of service there 
is clearly no need to impose intake quotas. But, assim^ng that the specified 
goals for target group service call for at lea^t some departure from the past, 
it may be necessary to introduce some mechanisms fc5r btlmulating intake people to 
depart from existing operating procedures. A quota system jnay be one-way of 
doing this. 

« m 

The examples discussed below will focus on intake strategies that functioti 
as part of a concerted effort to implement concrete client service goals where 
that goal demands* that those responsible for intake employ some type of standard 
in a systematxc way to select participants from the applicant pool. This means 
that our examples will be drawn from priin^^..a5ons&r ships in which* some 
positive and defiifeb4;e objecti ve Is as gi^^ed to Intake, and where that objective* 
appears to have been sttccp^?^rfuliy carried out. 
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Effective Intake Strategies; Some Examples 

The Klng-Snohomlsh Consortitm., which serves the Seattle. SMSA,, employs an 
l^fike system that la. tightly controlled and effective. The Intake, assessment, 
and referral -functions are ceiitrallsed in the sense that the Washington state 
ES is responsible for providing these services to all CETA applicants in the 
consortium, but is also decentralized in the sense that ES operates 11 offices 
f ok this purpose. The KSMC sjtaff, the sub-contractors, and ES have worked 
very closely together for a number o^ years to develop and refine this intake 
system, which was Initially based on an ES design. " , 

J 

The primary objective of the KSMC intake system is tb iaake sure that 
target group service goals are met during the program year. The planning staff 
of the KSMC, 1ft conjunction with the advisory council, establishes the 
target group goals. In recent years broad target groups have been preferred 
(ijiinorifties, females, and youth for FY 1978). Prime sponsor-wide goals are 
broken down by individual sub-cintractor , and service goals are set for each -of 
them. The ES offices, aware of th^ service goals of each subcontractor, make a 
concerted, effort* to refer' clients that will allow subcontractors to meet their ' 
goals. This procedure also guarantees that overall service goals are met. 
The sub-contractors have the right to reject ES referrals, but this right is 
rarely exercised. • " , 

Meeting the target group goals of the sub-contractors is not, of course, 
the only factor considered by ES in making referrals. They try to refer 
people who have been- waiting for the longest period* of time, and those whose 
assessment results suggest tliat 'they would benefit fran the program offered by 
the sub-don tractor . ' ' . • * 

The San Francesco prime Isponsorshlp's client selection system 
combines flexibility with a firm commitment t6 achieve certain target group 
service goals « The staff and the advisory council Identify a number of 
slgnlf Icaiit segments .(in recent years 12 different significant segments have 
been Isolated). Some of these target groups have guaranteed levels of 
a'eryfce assigned to them. This guarantee means that the minimum level of 
service as9lgned to these groups will be met during the year, even if it 
meafrs interrupting the normal flow of client selection. In FY 1978, the 
economically disadvantaged Latinos, Chinese, welfare recipients, Filipinos, 
Amcirlcan Indians, ex-offenders, older people and those with limited english 
speaking ability were all listed as '•minimum-level" target groups. For the 
other significant segiaents pTlicks, youth, and Vietnam Veterans for FY 1979) 
'^no fixed levels of service Are guaranteed.. , ^ . . 

The San Francisco CETA syeltem is decentralized, with most sub-contractors 
taking care of their own recruitment arfd selection. Those selected by the 
sub-contractors are then sent to the State Employment Service (JSO) for 
certification aiid formal enrollment. However, when monitoring reports show 
that a minimum ^evel* group is in danger of not meeting its service. goal, th? 
JSO, under the direction of the prime sponsorship staff, can correct any y 
Imbalances by imposing tight controls on client selection. This occurs very • 
infrequently, but the mechanism is present when needed. 

r 

^ Another way to promote nhe achievement of client service goals through 
the intake process is to establish a rating system for applicants that rewards 
""applicants who have certain characteristics. The Cleveland Area Western 
Reserve Manpower Consortium has established such a sydtem for its FSE programs. 
Points are given to applicants who fall into certain high priority groups such 
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as racial minorities, women, handicapped, Hispanlcs, those with less than a 
high school* education, those with liinlted English speaking ability, and those 
who have been unemployerf more than 40 weeks. Points are also given to those 
who fall into significant segment categories— youth, economically disadvantaged, 
welfare recipients, and persops over 40 years of age. The order of refertal' 
l;o PSE positions is then governed by the scores, applicants receive wh*n~^these 
points are totalled up. on their intake fom. This helps to jglve high priority 
groups an edge in the competition for PSE Jobs. 

The Baltimore Metropolitan Manpower Consortium uses its performance 
contracts to reduce some of the incentives to "cream" at the intake level, 
^ub-'contractors arc offered monetary bonuses for successfully training and 
placing participants with particularly low prospects of finding employment 
on their own. These "hard -to- train" participants are identified by v^ 
weak educational backgrounds, and low score^^ on aptitude tests. 'Thus, many 
sub-contractors encourage referrals of this type, ^ich is precisely the 
opposite of What occurs, in most prime sponsorships. - 

Another method for achieving pairticlpaait service goals >that lessens the 
tendency to cream is establishing eligibility standards that exceed those 
contained 1ft tHfe regulations. - Under the new CETA.^ legislation, eligibility 
has been more narrowly defined thdn^eVer. before. The prime sponsors discussed 
below had already successfully taken ste>8 to restrict eligibility before 
passage of the new CETA. 

■■ . ■ • . ■ 

In Bergen County only low Income applicants are accept&d in both Title i 
and PSE programs. Atlanta requires that all Title I (^participants enrolled in a 
component that* pays a wage 9r a i3tj.pend be economically disadvantaged. The 
Penobscot Consortium has a generkl ruli^of only accepting economically dis- 
advantaged persons in both Title I and PSE programs, but exceptions are allowed 
under "special circumstances." San Francisco has established its own me^adure 
of economic disadvantage. Instead of using the 7 OZ of the BLS lower living 
^standard', they use the CMB-approved' Orsh'ansky poverty level. The difference 
between the two measures is significant. For, a family of four the Orshansky — 
poverty leVel is an annual income of $5850; while the 70;5 of the BLS lower 
living standard figure comes to $7640 in the San Franeisco area. Syracuse 
requires that Title I participants be unemployed for at least 30 day? prior to 
entering the system, rather than the 7 day period mandated in the regulations. 
These examples demonstrate that it is possible to implement CETA programs 
effectively with relatively narrow eligibility standards. Although the new 
national standards are more restrlctivfe than before, they are. still inadequate- 
definitions of need In most prime sponsorships. Therefore, most prime sponsors 
will wish to add restrictions that more carefully target their programs to 
-people who they define as most in need. 

The city of S3rracuse has also been able to relieve some of intake 
pressures by setting up a two-step Intake process. Three agencies in the 
city are involved In screening CETA, applicants, one for the elderly, another 
for minorities, and the ES for everyone else (including minority and elderly 
people who do not go to the other agencies). The bulk of the applicants end 
up going through ES , which has worked very closely ove;r a number of years 
with the Syracuse Employment and Training Agency (SETA) — an in-house assessment, 
counseling, referral, training. Job development and Job placement operation. 
ES intake people, therefore, are well versed on ^ETA assessment criteria, which 
become the final determinant of what se^lces, if any, an applicant receives, and 
they use these criteria to guide them in making Intake decisions. This greatly 
reduces theniumber of people who appear at the SETA office requesting services , 
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soothe SETA staff jha8 an excellent opportiialty to engage in extensive 
assessment and counseling with those vho do come to them* / (The Syractise 
assessment system ia described in mor^u^tail in the next section.) This 
two step intake process helpis to tedude the pressures to q^e^am on both the « 
screening agencies and the SETA je>ff ic^. \ 

Aasiasament - ^. . , 

Creaming also occurs within CETA sy-stems — with the "best" clients 
routinely sent to specific programs. Some prime sponsors have certain 
programs (usually work experience) that may be used as a "dumping ground" 
for people who are accepted into the system* but are Judg^ to be unable to 
perform effectively In skill straining » OJT» or FSE programs. In some 
cases this is appropriate since a seqtience of programmatic services is 
planned for the clients but in other c^sfes nonsuch plws exist* This* again, 
points to the presence of a bullt-'ln tension between the demands of program 
operators to have people they feel they can work with effectively, and the ^ 
needs of clients with th« least hope of finding a Job. This tension is 
resolved for better or for worse through client ^as^essment. 

There is a f air amdunt.of consensu^ among CETA ad&inistraiors that \ 
client referral decisions should be Informed by bdth testing a!kid v r 

counseling, and that the end product should be some sort of employabllity 
development plan — a prescription of the services that a client should receive to 
become job ready. The nature of, these plans varies, as 4oes the extent to 
which they are used by those making* referrals. The section that follows^ 
presents a few innotvatlve and effective approaches to client assessment. _ 

Innovative Approaches to Client Assessment: Some Examples v 

The Bergen County Community Action Program (BCCAF)^ has developed a 
multi-faceted and effective client assessment component for their CETA system. 
During, the intake process an initial determination is made Aether an applicant 
is in need of CETA services. If this is judged to be the case the person is 
referred to an teQQ>loyment and training counselor, who works with the client 
to develop an employabllity development plan (EDP) * Several kinds bf assessment 
may go into the development of such a plan. One is simply in-depth counseling, 
or "person to piBrson" assessment. Another is educational testings sucn as 
GATE or other standardized tests, that provide Information on a client's basic 
reading, math, and verbal skills. Finally, and most interestingly, many 
clients are referred to a Career Decision Lab, where they are paid an allowance 
while being exposed to various career possibilities. Thai lab is designed* to test 
each person's Interest In^ and aptitude for, different employment careers. 
This assessment tool is especially useful for clients who have no firm 
career preferences whe^ they enter the CETA system. The final EDP, which 
outlines the services a cflent needs .to become job ready is a product of the 
results of the different assessment procedures, the judgioents of th^ counselors, 
and the preferences of the client. 

The key to client assessment in the eyes of the Syracuse Employment and. 
Training Agency is the personal touch. They begin by assuring applicants that 
emplo3niient references and tests will not be used to exclude them from the 
program, but only to pinpoint areas in need of development. They employ a 
limited number of tests. GATE iei^ used for everyone, and other tests are used 
to Inventory some clients* interests, and manual dexterity. 



. The heart of the 'assessment process In Syracuse la a 4 to 8 week ^one-^-one 
counselling activity for each client. They tr^,to match client and counselor 
very carefully jso that these seseH^ns can be. most fruitful. These * 
CQunsellng s.essttes are* opex^ and frank* S^enty^f Ive percent of jthe applicants 
CCTiplete the counseling and are enrolled in the programs Participants are also 
exposed to interview boards composed of , representatives of private sector 
anployers, ^^lcl\ h^lps to preparjs particlp^ants for real ln|f^rvlew situations > 
.and better to assess the -areas inhere Imptovem^t is needie4« All of these 
different components make up an extensive client assessment function^ which is 
viewed by^ S^A staffers as ,one of the strongest points ot- their program^ ' 
The 'end product of the assessment process jls a pre^ribed sequence of services 
for. each ^client Y and a^sl^ed. contract that C99inits prime sponsor to 
providing these .services/ ^ * • 



* / On^-of the inost systematic* attempts to structure client assessment .in a / 
manner that identifies gaps between a client's interests and skilly "and the 
requirements of the^'labor market lialj been established by the Penobscot Consdr- 
^tlum.'^^XJne striking feature of their cll^t assessment procedure 1« the 
conscious emphaais on bringing the demands and expectations of future 
employers Ih^o jthe assessment stage of CETA. In this way the "human /lap^ltal 
gap'I for eacjjr client can be clearly dellneatfedt Mdst of the specific , 
components of what the PCTEA calls a "partlcipani: assessment matrix,*^ whlcth 
they .develop for every client, KaVe been mentioned in the discussions above. 
The structural characteristics' (age, sex, race), educational and triBdning 
exper jfenges , employment history, interest profile, i>aslc and Job related 
skills^, aftd behavioral characteristics (appearance, motivation, punctuality) 
of the clients ^e assessed and listed on one form, so that their personal 
barriers to employment can be easily identified. Once the matrix is completed 
an employablllty plan that prescribes the service appropriate for remedying 
the' laentified employabllity problems is developed and Implemented. 

■ * * 

E. \ LABOR "MASiaST ANALYSIS 

One . of the often cited advantages of decentralized^ (as opposed to 
ca'fcegorlcal) employment and training programs is that they greatly enhance 
the ability of /planners to design programs that corre8i>ond to local labor 
market conditions. This, of course, suggests that prime sponsors can and *do 
conduct meaningful labor market analyses, and that this research is usen in 
making decisions about program design and operations. However, we have 
bbserved that much of the large quantity of labor market- dftta that has been 
collected or generated by CETA planners is used only fbr the purpose of 
satisfying DOL' grant application requirements. There is^ften vety little 
Integr^aitipn of. labor market information and program plan»ng; 

The fact* that labor market analyses are frequently puf to very little 
use by tho6e designing and operating CETA programs may rfesult from poOr staff 
drganl2fatlon^ the' insehsltlvlty of labor market* analysts to the needs of 
Operations staff, or the unwillingness of the senior staff to be guided by 
''^th^ results of labor market analysis.^' 

In many cases hdWever, labor market analysis Is ignored because of data 
limitations. Altllpugh labor market data are usually available in large quantities, 
the data;are often of such poor qtiallty that it cannot yield answers to 
questions of primary toncem to CETA planners. Most prime sponsors rely on ES 
labor market trend data, 'newspapers , national econoniic indicators, and labor 
market studiesz-tiomplet^d by other local organizations (such as Chambers of 
Coomerce and. regional planning cosmission) to project labor market trei^s. 
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It Is coBskm for the prograai planners^ the operktlons staff , aAd the 
iabot market analysts th^nselvesN^o agree thst limitations in these data make 
. t^em a very unreliable . hasd^ for malclng prograjnmatlc decisions. , 

^ . . ■ ' 

/This recognition leads oany prime sponsorships to look elsewhere for 
more reliable labor market information. Judffa^ts offere4 by different local 
"experts" (or other contacts) are sought and often. used Instead of the 
quantitative projections to inform i>rogrammatic decisions and placement - 
strategies. lia some cases (Careful efforts a^e made to c&eck the reliability^ 
of these qualitative data sources > and miake those with proven records of , 
accuracy part of the formal labor maifket ■ information system. In other cases. 
Judgments of varying degrees of reliability' are received In a seemingly random 
.\ fashion, and exert a very unsystematic influence on decision-makexrs . 

*In this section Innovative approaches ' to the colsSftlon and use of 
quantitative and qualitative labor market Infoicmation will be described. 
A necessary condition for any approach to be designated as innovative is that 
it be used to help determine the design and operation of CEm programs. Many 
very elegant analytical routines exist Jthat have not been shown to be useful 
in practice, and therefore will nOt be included in this report. In addition 
to proven usefulness we are Interested in approaches that are both unusual 
and imaginative. 

Innovative Quantitative Approaches tb Labor Market Analysis; Some Examples 

Probably the most systematic attempt to use 'quantitative labor market 
information to inform decisions about training priorities that we have 
observed is a system put in -place in the spring of 1978 by the Denver 
Manpower Administr^lon (DMA) . Their approach allows the DMA planning staff 
to go beyond the simple identification of areas of employment demand, and 
pinpoint specific areas of emploirment growth most suitable for CETA trainees. 
This is done by employing a number o'f different data sources^ The Annual 
Planning Report issued by the Colorado Department of Labor and Training is 
used to identify growth occupations for the upcoming years (growth is defined 
as 100 or more openings, or a thirty percent grwth rate over the next five 
years). Last year 138 growth 'occupations were Identified. These growth occupa- 
tions are then checked and double-checked by consulting other laboV market 
data the DMA staff has available. These' alternative data sources Include 
employment projections and lists of unfilled openings developed by the Department 
of Labor and Training, reports on worker demand and supply from the Board for 
-Community Colleges and Occupational Education, and want ads in local newspapers. 

In conjunction with these data that Identify demand occupations, detail^ 
information on average hourly wages and advancement opportunities in each 
designated occupation is assembled by the DMA staff from a wage survey and the 
Occupational Outlook Handbook published by the Bureau of Labor Statistics. 
This ' information is used to rank demand occupations according to the benefits 
they appear to offer to CETA trainees. The ranked occupations are then related 
to the requirements (education, experience, training, etc.) they place on 
applicants, and the rate of personnel turnover Is considered before the staff 
comes up with a final, index of high priority areas for CETA training. The Wk 
hopes that this systef^ will help them correct some deficiencies in the training 
component of, their Title I program. 

A nuoiber of other prime sponsors employ quantitative data sources to 
project job opportunities that go beyond the "standard" sources of labor 
market information mentioned before. Some of these data soui^ces are available 
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onlV In particular prlae aponlorahips , but otfiiers could presXimabiy be of 
benefit to «any other prime sponsors. A f «w of ttose vlll be discussed below. 

The QGsaha Censor tltn coanlssloned the Center for Applied Urban Research 
at the University of Nebraska at Omaha to do a series of lab^r market studies 
covering the Ooiaha SMSA. In one spidy local employers were surveyed tt> 
determine growth occupations In the SMSA^ and more specifically to Identify 
openings In entry level and paraprofesslona^ positions and sources of 
training for .these jobs. The Center also did a more gieneral study of the 
structure of the local labor market by Ifidustry and occupation for the . " 

cOhsortlum. This study Included projectlctos of areas of growth, and covers 
the^f^er^od from W70 to 1985. Many other prime sponsors have, contracted ^th 

edlleges or universities for studies ?.lke these, and It seems to u5 to 
be an- option that has wide potential applicability. 

The Penobscot (Maine) Consortium "has taken a couple of Interesting steps 
to improve the quality of the quantitative labor market ds^ta with which they 
have to work. They have used Occupational Baployment Surveys conducted by . 
the Maine Department of Employment Security In J.973 and 1977 to trace labor market 
tirends In a number of Maine Industries over time. The consort lua also 
strongly supported a proposal before the Maine SMSC to fund a statewide 
survey to gather Information on youth employment patterns. When the study 
was completed the consortium convinced the University of 'Maine— the contractor 
f oi the, survey— to break out the results for the Penobscot Consortium. They 
were thus able to obtain up-to-date labor market Infoigatlon at a relatively low 
cost. ^ 

In Syracuse the Coiaaunlty Council on CSareers In Greater Syracuse makes 
available a series of reports that project Job openings In manufacturing firms 
based on a survey of local employers. The prime sponsor Staff uses these reports, 
to supplement the more standard data sources they have available in the 
compilation of a yearly Labor Market Report . 

These samples are Intended to illustrate the point that prime sponsors 
can usually improve the quality of quantitative labor market data they use 
in planning either by making a systematic effort to seek out and tap existing 
data sources in their localities (as in Syracuse and Penobscot), or to take 
steps to see thaV4>etter data are generated (as in Omaha and Penobscot). 
These steps do not have to be expensive or time constmlng if the options are 
thought through clearly (some prime sponsors have funded PSE projects to 
survey employers, which can be an Inexpensive way to collect labor market 
data). The improvement In labor market inf onJMation^can be substantial. . 

Innovative Qualitative Approaches to Labor Market Analysis: Some Examples 

The Baltimore Metropolitan Manpower Consortium has established an 
Impressive system for using qualitative information on job openings and labor* 
demand projections obtained from members of local labor unions and business 
firms in labor market planning. This Information ultimately, becomes a major 
determinant of the types of skill training programs the consortium will offer in 
any given year. 

♦ The prime sponsor staff has worked with members of the local business 
coianunity and labor unions as well as representatives of local schools to 
create 15 Labor Market Advisory Councils. The Councils are organized around; 
distinct employment and industry categories (for example, building trades, 
mechanics, ship building, cooking) and they perform a number of functions^ 
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^Alch help to iaiprove the qu&llty of the labor narket Information the staff ' 
has available. Every year, during the planning process the LMAC& meet as a 
giroup and react to staff-developed labor market projections that already 
Incorporate variojus data sources Including a survey of local employers. 
Empioyers on the councils describe their hiring plans in the areas identified ' 
and provide further details such as the kinds of qualifications they will 
require, the wages that will be offered, and the advancement possibilities 
associated with different positions. Union and other labor representatives 
report on the kind of training the jobd require, working conditions, turnover 
rates, and related .matters . The basic mission of the IMACs is to supplement 
the qsiantitative projections developed by the staff and pinpoint those occupati 
that the CETA system should address. 

In^ addition to this very specific and formal function the, m&Ca pertorm 
during the planning process, members of the councils help the staff at various 
times during the year by reacting to late-breaking plans, reviewing proposals 
for training programs, and evaluating on-going training programs^ Thus, the 
councils act as both a formal deliberative^ body (meeting at least two or 
three times a year) and an Informal network of contacts whose knowledge and 
services are frequently requested when the staff faces difficult problems 
for ^Ich their expertise is par titular ly appropriate. 

In Syracuse a similar, but less elaborate process for integrating 
public input and staff projections in. an analysis of the local labor ^market 
has been established, ^en the staff completes its yearly Labor Market 
Report it is referred to the Research Committee of the MPC. Committee members 
offer the same sorts of observations that the m^ers of the Baltimore IKACs 
provide, and this information is used in decisions relating t^ the 'kinds of 
trad^ilng programs the city will offer during the next year.- 

The Albuquerque consortium goes even farther than Syracuse in the effort 
to Incorporate the services of advisory council menbers in labor market analysis 
The Economic Development and Labor Market Tiask Force of the Consortium Planning 
Board* is responsible for working with labor market data to determine areas of 
emplo^nt opportunities for CETA trainees. They are, of course, assisted in 
thl^ effort W the staff, but the- staff functions mainly in a technical 
assistance edacity, and;^does not offer a great deal of substantive input. 
The task force members themselves are, therefore, the major' actors in the labor 
market planning process. 

-.1 

The most conmon form of qualitative information on labor market conditions 
used by CETA planing staffs is supplied by CETA Job developers. While most 
prime sponsors Incorporate the observations of Job developers into their labor 
market analysis some do so more systematically and effectively tnan others. 
The Bergen County Conmunlty Action Program, which administers all the CETA 
programs in the county, has evolved a very effective process for feeding the 
observations of job developers back into the planning process. A centralized 
Job development unit carefully divides the county into sectibns and contacts 
all relevant employers four times each year. The primary purpose of this 
activity is tp locate Immediate Jobs for CfiTA participants, but a very 
Important secondary purpose of this exercise is to develop Information on 
current and future demdnd occupations « Job developers slso Inform plAnners 
about the areas of skllf training In which they have encpuntered difficulty In' 
placing people^ and those In which placements have been easily secured. All 
of this Information la used In an effort to make the best possible choices 
about the types of skill training programs that should be offered. 
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F. SYSI^ DESIGN: SERVICE DELIVSto SELECTIOti, SitRVICE DELIVERY SYSTEMS, 
AND PERFOKWASCE CONTRACTING '• ^ 

One of the major decisions prime spoi^or ships make Is the selection ' 
of ^service delivery agencies . There la always potential for a fair amount 
'of conflict to arise In the course of making these choices*; no prime sponsor 
welcomes the kind of . petty bickering and Infighting among rival service 
dellvei^ers that can and often does accompany funding decisions. Consequently, 
most prime sppnsorshlps develop soiqe method for reducing thl8/t3n>e of conflict; 
However, some prime sponsorships also recdgnlze £hat^ a little competition 
between service delivery agencies may lead ^o the imptovement of the syptem as 
a whole, and make some effort to promote \^at they hope will be healthy'' , 
competition. - - , ^ • . , 

The importance of 'service del^lverer funding decisions depends otl the *^ 
extent to \*hich the service delivery system is open or closed, llany ptlme 
sponsorships effectively eliminate conflict over service deliverer fuodlpg 
decisions by« maintaining the same set of service delivery agencies at more or 
less the same level of funding year aft&r year. In such cases funding, ' 
decisions Infany given year tend to be routine. Incremental, and not particularly 
interestihg or important. In other cases the system is open, at least to some 
degree, ^Ich means that funding decisions are quite significant, and the study 
of how some prime sponsors make these choices can be useful for prime sponsorship 
staffs. 

Il^ile the way in which service deliverer funding decisions are made is 
often important, the results of such decisions are even more important. Every 
aspect of a CETA system is affected by the number and type of agencies that 
are selected to operate employiaent and training programs. «ot sinrprisingly, 
variation in the extent to which CETA programs are subcontracted to outside 
agencies, and the kinds of agencies receiving the subcontracts is great. 
Some prime sponsorships are convinced that operating all or most of the programs 
within thtflr own organizational 'structure is the only way to make the system 
manageable and responsive to changing policy standards and economic conditions. 
* Others believe that a mix of ln-4iouse and subcontrac-ted programs is desirable. 
Still others are firmly conmltted to the idea that the prime sponsor staff 
should be. purely administrative, and the responsibility for operating programs 
should be sub-contracted. 

In this section innovative ways of chosing among competing service deliverers 
will be described. We Include approaches that have been observed to work in v 
situations in which the decisions are recognized by everyone consequential a 
ones. By "consequential" we mean that the possibility existed for agencies not 
receiving funding in thQ» previous year to be funded for the following year , or that 
current service deliverers might be defunded, or that changes in the operational 
responsibilities, and funding levels for an existing set of service del^iverers 
might be made. ^ 

Exemplary models of service delivery systems will also be described. The 
' models presented will represent the three general models referred to above: 
those in which all or nearly all the programs are operated In-house, those in which 
a mixed pattern of in-house and sub-contracted program operation exists, and 
those in which ail or nearly all the programs are subcontracted to outside 
agencies • 
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Bxeaplary Service Deliverer Selection Processes 

Many prime sponsors have decided that, the best way to malke rational » 
open» and jii i r|fcmnni i iii fi nl \ i1 service deliverer funding' decision , while 
keeping conflict among service deliverers * under control » Is to Institute a 
formal Bequest for Proposal (RFP) process. In most cases, the MPC, or 
som^e public body outside the staff. Is brought In to review the prqposals and 
make fimding recommendations so as to reduce the chance that favoritism 
(or the perception of It) will creep Into the selection process. Our view 
Is nbt that a formal SFP Is a panacea for the problems Inherent Ip service 
deliverer funding decisions , but we have observed a few that ^eem to work pretty « 
well. , ^ , ^ 

Many problems have beset those who have attempted' to use an RFP process to 
make service deliverer funding declsloitsV Iji sob^ case^, the process Is 
viewed by all parties Involved as an unnecessary burden because It has nq^ 
Impact on the outcome of funding decisions. In other cases political Influences 
Interfere In a way that distorts the selection process. Still other prime 
sponsors haVe found that the Introduction of an, BFF greatly expands the 
scope of conflict over funding decisions, since new groups that previously 
had no knowledge of, or Interest In, CETA are activated by the public KFF. 

The Atlanta prime sponsorship established (after a nuxober of years of 
experience) a carefully constructed and systematic service deliverer 
selection process. The staff Initiates the process by drafting a Request 
f o^ Quotation (SFQ) , which Invites agencies In the city to submit proposals 
for specified services. The RFQ replaced a more general RFP when It became 
a burden because It was too open ended. The RFQ not only provides a general 
outline of the kinds of services requested, biit also stqpplles detailed 
program requirements. The draft RFQ Is reviewed by air units of the prlm^ 
Sponsor staff, and th6 final version Is mailed to all agencies on their 
bidder's list and the city council. It Is also advertlsjad In local media. 
Potential contractors are given two weeks to stibmlt proposals; the proposals 
are reviewed the following week. 

Reviewing proposals and making funding decisions Is the responsibility 
of subcoianlttees of the advisory council. These subcoioalttees are organized 
around functional categories (Intake and assessment, skills training,' OJT, and 
so on), and appointments are, made so as to avoid any conflict of Interest. 
Funding recomn^ndatlons are based on aerating system used by the subcommittees. 
The system takes Into account various factors. Including past performance. 
Subcommittee recommendations are passed on to the full advisory council, 
which has to reconcile the different subcommittee recoisnendatlons with thb 
reality of the exf^cted budget. The Job has recently been made easier by 
designating some services as "core" components af&d others as "peripheral." 

As the service deliverer funding process unfolds each year In Atlanta 
the staff Is very mtich Involved by providing data and recommendations to the 
subcommittees and the full council, but appears to let the advisory groups 
make the final recoio&endatlon^ on their own. The Mayor, of course, has the final 
authority to choose service deliverers, but he has rarely used this authority 
to overturn advisory council recommendations « It seems clear that the 
existence of this elaborate formal process makes the Mayor more reluctant 
to act against the wishes of the council than would' otherwise be the case. 

The San Francisco prime sponsorship employs a similar process, but 
the staff of the Mayor's Office of Employment and Training (not the MFC) 
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reviews the proposals received i» response to the BFP. A task force composed 
of varlotis units of the MOET (fiscal, njonltorlng, planning,* contracts) la 
created each year to conduct the reviews. Meabers of the task force do not 
cooBtunlcate^wlth agencies submitting proposals during the entire period in „ 
which the^roposals are being reviewed so as to avoid aay charges of favoritism. 
«Thls review results in a ranking of the prop&s<aas baaed on a standardized list 
of criteria Including, where a^pUcable, past performance. The original propo- 
sals, plus the staff rankings, are then sent to the Evaluation Coomlttee of 
t^e Advisory Council, which reviews the material, and conducts public hearings 
fox; proponents of the programs who wish to plead their cases. Thus, the 

• cotocll performs the buffer function, But the staff is able to interject 
more of their acquired expertise Into the review of program proposals. ^ 

The public SFP route is not the only Wy to structure a good and workable 
service deUwerer selection process-. . The Baltimore Metropolitan Manpower , 
XJonsortluip has also used its annual selection process to introduce new programs 
into the system, alter t;he operaU«>nal responsibilities of some operators, 
and to press all the /agencies with whlph* it subcontracts to achieve better 
performance. The-a^ectlon process they employ, however, is in many ways the 
opposite of ythe-public BFP. The MOMR staff has long insisted that service 
deliverer selection and funding decisions are best viewed as technical 
decision§,( And should., therefore, be primarily a staff responsibility. Thus, , 
in Baltimore, agency funding decisslons are not Issued for public dlbate 
and political squabbling, byt are handled In private negotiations between the 
staff and the prospective service delivery agencies. 

This type of approach can work in .Baltimore because it is complimented 
by many other components of their CETA system, many of which have been 

• discussed In other sections of this report. The MCMR has excellent labor 
market Information and uses performance contracts, which are backed up by W 
a strong mcmitoring and evaluation effort. Contractor performance is 
thorou^ly assessed each year. When it comes .tim6 to make service deliverer 
funding decisions the staff has data on both the need for a particular service 
and, where applicable,- the past performance of the subcontractor proposing to 
offer it. 

Exemplary Service Delivery Systems 

In-House Systems of Operating Respbnsibility > Probably the strongest 
exanple of an in-hbuse delivery system we have observed id the Penobscot 
consortium in Maine. Many of the oft-praised (but seldom observed) aspects 
of the "ideal" CETA system are present In the PCTEA. The program is compre- 
hensive, integrated (both administratively and progranmaticaUy) , effective, 
well-managed, and responsive to local conditions. This situation has cotae 
about because a dedicated, hard-working and imaginative staff has been given a 
great deal of flexibility (indeed almost experimental conditions) to design 
and Implement a model employment and training system. 

The core of the delivery system is the four Offices of Training and 
Employment Programs (OTEPs), which are strategically located throughout the 
area served by the consortium so aa to provide access to employment and training 
services to everyone in the consortium area. Each office is in a position to 
offer clients the full range of CETA services (assessment, supportive services, 
•ABE, WE, CT, OJT, PSE, and so on). Employablllty developers work with 
clients to establish employablllty plans and continue to serve them In a 
counseling capacity aa they proceed through the pre«:rlbed sequence of services. 
It is coamon for the employablllty plan to call for,khe client to participate 
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In aore than one Df the traditional programs (VE, OJtJct, PSE). In most 
cases a diet's exit program (which could be OJT» CT,A^ PSE) includes a 
commitment to liire' by an employer, if performance is satisfactory. 

* ♦ " ■ 

Despite recent ''movement at the national level in the directicm of 
, re-establishing a more categorical approach -to' eatployment and training 
programs, th^ Penobscot consortium has maintained a unified delivery system. 
Intake, assessment, counseling,' referral^ and placement for almost all the 
programs take place in the OTEPs. The only ^ception is project PSE, which 
is taken care of through the local ES office (this and a Small OJT 
subcontre^ct with .the local AFL-CIO 'are the only non-in-house aspects of the 
system). Thus, Penobscot has been able; to iitiiplement what many other prime 
sponsors are only able to conceptualize in abstrac^t terms. The different 
components of CETA are not only viewed and planned as if <. they formed a unified 
whole, they are actually operated according to this vision. ^ 

« . • - * 

The activities of the (flEP offices are centrally coordinated by the Area 
Operations Bepartment of the PCTEA. In addition to the/intake» assessment) 
counseling/ and referral responsibilities Just described » the Area Operations 
Department oversees and directs staff meisbers vdrjk;^g on the development and 
coordination of OJT and PSE positions ^ skill traliiitng classes, and work 
experience sites. An especially noteworthy feature of the Penobscot system 
is that th'^y have not sunk costs into ongoing training programs so as to 
malntalfi the flexibility to shop around to find opportunities for class size ^ 
training that fit local l^EEor market conditions* A smaller, but independent . 
staff utilt, the Of flee of Private Sector Initiatives, provides valuable assistance 
to the Area Operations Department in such activities as client assessment, 
training workshops, and the development of CT and OJT positions. The Area 
Operations Departinent also maintains close working relationships with all the 
other staff units within the PCTEA. These Include the Planning and Fiscal 
{departments and the Office of Policy Evaluation and Research. 

Mixed Systems of Operating Responsibility . ,The Syracuse^ prime sponsor-* 
ship successfully operates its CETA programs using, a mixed system of in-hbuse 
and suti-contracted operating responsibility. E&rly in CUTA the staff 
settled on the idea of operating the key components of the system in-^liduae, 
while sub^contiiacting some ancillary services to outside ^gencles^ The 
one exception tjo this pattern id a continuing subcontract with the Board of ^ 
Education to rt^ the Skill Center, which is clearly a key program component. 
The staff believes that by maintaining direct control over the operation of 
most key aspectjs of the system it can Insure basic standards olr quality, 
provide a cleaf sense of direction, and encourage integration with other programs. 
Sub-contracting some parts of the program was considered Important because 
the staff wanted to encourage some agencies, which were providing services 
outside the CETA system to participate within the system, to give important 
client groups an agency perceived to be sensitive to* their needs, and simply 
.to take advantage of some agencies^ whose competence had been proven through 
past performance. ^ * • ^ 

Assessment, OJT, WE, individual referral, and job development and placement 
are run In-house. A former Model Cities agency does intake and recruitment in the 
milnorlty comnunlty; another community organization does intake, recruitment, 
and job development for older workers. The Emplo3nttent Service performs a general 
recruitment and intake function. Remedial^ education is the responsibility of the 
Education Opportunities Center connected with the state university. Finally, 
the School Board runs the skill center. Negotiations between the skill center 
and the staff have been serious and prolonged.. The nature of the Center *s 
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* operaitlon has chWiged substantially since the beginning of CETA, mainly as 

a result of the constant prodding of the OFSAC staff. In this case the basic 
'determination of the staff to have the key components of the system operated 
> according to their standards has extended beyond the programs run In-house to 
include the sub-cbn trap ting agencies. 

While Syracuse la an example of a mixed system of operating responsibility 
that is weighted slightly In the direction of an in-house model, the Baltimore 
system Is a jnlxed system that favors the subcontractor model: many of the ^ 
* core prograimnatlc functions are sub-contracted to^cmtslde agencies. All intake, 
aBaesamei!i^,«,,^d referral, and part of ^ the job develofnnent and. placement . 
"responsibility Is located in the 21 manpower service centers (MS06). Most ^ of 
these centers ^re run by outside agencies (community based organizations, ES, 
and county |;ovemments) , but a^^w are operated directly by the HOMR.^ Skill 
training is sub-contracted to W^erSl training organizations In the consortium 
area* These training sub-contractor§ also have Job placement re^onsiblllty 
for their trainees. The MOMR operat^||^JT , BSE , most WE, and a central Job 
development service in-house. ^^"^^...^ ^ 

The reasoning behind this si^t-up Is fairly straight-forward. The decision 
to set up the network of MSCs was^ based on the desire to take advantage of 
the strong neighborhood ties of many codtmunity based organizations In the city, 
and to utl^:|^ze existing services (ES and county government) in the counties. 
I» In choosing training sub-contractors the MCMR favors organizations with diriBCt 

employer contacts , because ^ese types* of training outfits have In the past shbwn 
themselves to be most effective In providing quality training and securing 
placements. The In-house operation of OJT and WE came as a re^lt of the 
inability of previous sub-contractors In these areas te^perConortip to staff 
expectations. Similarly, the central Job development unit was established In 
response to perceived shortcomings In previous Job developinent efforts. The 
success of this system of operating responsibility Is heavily dependent on the 
use of performance contracts, and the extensive monitoring and evaluations carried 
out by the MCMR staff. ^ r 

Systems of Sub-Contracted Operating Responsibility . The San Francisco 
prime sponsorship subcontracts all Title I operating responsibility. During 
FY 1978, more than 30 agencies provided CETA services under Title I in the city, 
with many of the agencies delivering more than one service. Eighteen agencies 
operated classroom training p^grams (Including engllsh-as-a-second-language) , 
6 provided OJT, 4 ran WE, and^^worked on other activities. * The San 
Francisco staff believes that the sub-contracting model Is the best way to 
operate a CBTA system In San Francisco for two basic reasons. First, utilizing 
a large number of service delivery agencies allows the diverse and numerous 
constituency groups that exist In the city to be represented In a very concrete way 
within the systefl^ Twenty of the 30 sub-contractors are community based x * 

organizations that represent ^.ocalf constituencies. Second, the San« Francisco ^ 
staff recognizes that with a large number of experienced deliverers with proven 
records of performance, it would be senseless to exclude them from the system. 

- The central component of the San Francisco system Is a central Manpower - 
^ Services center operated by the Job Services Office (JSO) (ES in Ci|[llf omla) . 
This office certifies all applicants, does Intake and recruitment for some 
service deliverers, handles all supportive services. Job development and Iplace- 
ment. The JSO also verifies all terminations and placements. The other programs 
and services are provided by many deliverers. The largest single program is 
classroom training, which takes place at the skill center. . 

\- 
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The reason that this vlde*-ranglng operation xan function ef flclentl^^d 
effectively Is that the MOET staff inalntalns firm aaftlnlstratlve control over 
several critical aspects of the system. For example » service deliverers are 
not assured of funding for the future « ^or existing deliverers past performance 
Is the 'primary criterion taken into account when Service deliverer funding 
decisions are made. Since the beginning of CETA several ag^clea have been 
dropped y or had their operating responsibilities changed , and a iaumbelr of 
new. agencies have been brought into the system. Probably the most important 
means of control are th^ performance contracts and an elaborate monitoring 
'system. 

Pe rformance Contracting 

^ Most prime sponsors use edither a mixture of subcontracted and In-house 
manpower services tr subcontrack: everything. ^ There are a number of sound 
reasons for subcontracting, includlijig the use of programs of demonstrated 
effectiveness, the ability to cnange program mix through altering the types 
of subcontractors chosen, and t^e advantages of using organisations with 
established clientele groups. 

Howevef , having a lot of subcontracted services can also create problems. 
Coordination of manpower prograssB may be difficult to achieve* There may be 
a long lag time between the intrpductlon ^of jihanges by central staff and responses 
by subcontractors. Program operators may cream the applicant pool. One 
particularly effective method fof countering these problems is ab approach 
known as performance contracting; 

In their simplest form, performance contracts provide for relsibursement 
of program operators when specific services are complete or when particular 
goals are achieved. They may be highly detailed and tailored to the work of 
a particular contractor, or broad and af^licable to all service deliverers* 
The central purpose of the contract is to inf luca&ce the behavior of the 
subcontractor in desirable ways determined throtl^ negotiation with the 
coQUractor. While several prime sponsors use one or another form of performance 
contracting, one that w^s most interesting and useful was the method used by 
the Baltimore Metropolitan Manpower Consortium. 

As noted in other sections of this report, Baltimore has a very large 
and complex system of subcontractors; almost all services are run by agencies 
outside the prime sponsorship. Consequently, the process of negotiating a 
contract for services is a moat important one. A griea^ deal of staff energy 
and resources are devoted to this process , whi^h may take place at several 
times during the year as contracta are made to meet changing circumstances. 
Intensive negotiatiotiB always take place during the planning process for the 
upcoming fiscal year. 

The Baltimore staff initially started with "goal oriented" contracts but 
they fhifted to performance contracts in the last two years. The nature of the 
contracts varies with every deliverer because^he staff has information on 
the strengths and weaknesses of each one and makes use of this information in 
negotiations. . There are similarities between types of contractors, however. 
The Manpower. Service Centers, which handle intake, referral and direct 
placements, are reimbursed for enrollment and for placements* They are also 
recj^ired to meet certain quality standards, such as a 3 to 1 referral ratio to 
training agencies. ^ 
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The training agencies are reisnbursed on a- more complicate/ baals. Some 
are paid only for costpletion and piacment. Others axe paid percentages of 
the total cost of services at various stages, such as initial enrollment, ^ ^ 
training mid-point, completion of training, and placement. The actual contract 
depends on the staff's assessment of the contractor's performance. ^For 
Instance, if the staff finds that enrollees are finishing the mid-pblnt of 
training, but not coiopleting the program at the same -levels, thai they inay .put . 
more of the reimbursement in the completion end of the program^ This 'will give 
the subcontractor more Incentive to get people to finish. 

An example of the vay Baltimore uses the performance contract Is 
displayed below: ' - 



Changes In Performanf^ 
(percent paid 


Contract Over Time 
to «on tract 6r) 






Year 1 \ 


Tear 2 


.Jtear 3 


Enrollaaent 




30Z 


.30Z 


Mld^-Polnt 


0 


30 


30» 


Completion 


- 15 


30 ^ 


20 


Placement 


0 


10 

0 


20 . 



In the first year of the contract they -placed primary emphasis on enrollment. 
In the second year they were able to push t^e contract to^ concentrate on getting 
the person through training. In f|he third year they added even more emphasis to 
the placement of trainees. By adjusting ttie amount of reloibursement f or 
different tasks they are able to make the contractor do what they want them to 
do and l^lp the contrajj^tor improve' in areas in which they are relatively weak. 

i ■ * 

Baltimore also used an interesting tuethod for reducing creaming in 
their programs. They negotiate entry sltill levels with the subcontractors and 
attempt to keep them relatively low. They have written bonus clauses into 
the contracts of several training deliverers sto that t!(ey will' be encouraged to 
enroll those that fall below the negptiated entry level. For example, they pay 
several contractors a $100 bonus for enrolling and placing non~high school 
graduates. 

The Integrity of the performance contracting system is maintained by the 
staff program analysts ^o monitor the enrollment levels and other Management' 

-Infomatlon Reports of the contractors. Equally significant la the fact that 
completion is defined as the attainment of a specdLfic skill level, rather than 
simply finishing the program by putting In a required amount of time. The 
iklli levels are tested by the staff of the prime sponsor evaluation unit or 
by representative's.^ local Industry. Finally, the staff' verifies all 
placements Independently so that they pay the contractor only for work actually 

' performed. 
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PARTICIPAHT PLACEMENT SpATBGIES 

. ' . , ' * < - • 

Although the acknowledged purpose of most employment arid training programs 
is to prepare participants for eventual placement into unsubsidized joba, there 
Is surprisingly little solid knowledge about the most effective placement 
strategies. This problem is^-partlcularly troublesome, and almost universally 
acknowledged, 4n the area of private sector employment. CETA administrators 
talk a lot about "job development" and "marketing," but it is fairly clear 
that staff members who work on. placement serve prisiarily a labor exchange 
function. They do not often convince^employers to create "new" positions, 
- but instead direct trained CETA clients to openings that have been identified 
through traditional sources.^ ♦ * . ' 

^ Maity who* have observed CETA programs are surprised at the fact that 
telatively few staff members work on job placement. This would seemingly be 
an area that would command a significant share of staff resources. However, 
most prime sponsorships devote a Vether small amount of their staff resources 
to this function. One reason for this is that job placement nmst compete with 
many other functions and services for CETA administrative resources that 
are devoted to maintaining the Inputs to. the system and meeting* federal 
requirements. Another is the recognition that CETA job placement is mostly a 
labor exchange activity, which in theory should be available through local 
employment security offices (ES). Prime sponsors with and without the 
encouragement of the DOL have established every Imaginable type of relationship 
with local ES offices to promote job placement,' but in nearly every case one* 
conclusion seems to emerge: job placement for CETA clients cannot be adequa'tely 
provided by relying only on the regular ES placement service. There is a 
legitimate need, in other words, for some sort of job placement service 
designed specifically for CETA clients. 

Since placements are a critically Important outcome of CETA programs, and 
are readily quantifiable, th^y often become a key evaluative indicator. 
. This, obviously, creates an. incentive for prime sponsors, program operators 
and others to pursue a strategy of maximizing th^ number of placements, without 
much regard ^lar the quality of those placements. Thus, a practice well known 
by those In the CETA system is to place people Inio j-obs for vhich their 
training does them very^ little good, and which offfer very little in the way 
of long term job stability or advancement. This type of strategy does a lot 
to undermine the value of CETA programs^ and although prime sponsors using 
it can often display Impressive placement rates, they will obviously not J)e 
included in our presentation of exemplary placement strategies. 

• The following discussion of placement strategies emphasizes the "indirect 
placement" of participants tfho have received 'some type of classroom training . 
Most CETA prime sponsors also place a certain number of applicants directly. 
That is, they succeed in finding jobs for applicants who come to them job 
ready. Direct placement strategies will not be discussed because most prime 
sponsors do not have explicit strategies for placing job ready applicants, 
and because this activity seems peripheral to the main mission of CETA. 
We do not wish to Imply that only classroom training programs- are relcsvant to 
placement; WE and PSE programs will also be discussed where they are part of 
a comprehensive effort to prepare participants for eventual placement.. 
However, the identification of OJT positions, which ofte# takes place in 
conjunction with efforts to place clients who have received training in the 
other programs, will not be addressed. 
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A final point -that should be made by way .of Introduction la that not 
all ^rlme spcnaors havie. anything resembling a "placett^nt strategy.*' 
Placement is often only a fiinctlon that constitutes one part of a system 
of unconnected and uncoordinated functions • Taking into account all of 
'"^these initial observation^ , it 'seems reasonable to assert that th^ ideal 
CBTA placeitiknt system would involve- two basic components: 'First, an 
arrangement for u^ing job openings that ES and other placment sedryices have 
identified, aswwell ad the capacity for identifying and developing additional 
opening^, either by canvassing employers, or by some other means; second, a . 
method tor matching clients to Job openings so that the employers* needs are , 
laet, and so that the clients are receiving . the kinds of jobs that lafika use of 
their C£TA training, and lead to. long-term ^ployment. . . ^ ■ 

* ■ • " ■ •• . 

Worklag with the Baployment Service . * . 

The introduction to this section suggested that prime sponsdrs should 
establish some sort o£ arrangement with ES for job placement* However, many 
prime sponsors have no such arrang^ent , and. In many cases have dotmd 
reasons (usually a lack^of faith In ES' ability to perform) for not having 
. thjam*. A few examples from, among those which do work with ES on placing ^ 
CETA participants merit dlacusslon In this iiectlon of 'the report. 

The San. Francisco prime sponsorship has ^ fairly typical placement 
arr^i&gement with ES; (JSQ In, this- case), ^>ut one that 'works qui±e well becatise 
of the strong working r^l^^ns^lp between the CETA staff *ai&d the JSO, a 
relationship developed ^^I^^B^umber of ^years, and the prime sponsor's 
effective use of ^performalH^ontracts to Insure placement results. The 
arrangement that has been established gives the JSO primary placement responsibility 
for all graduates of the skill center and those coming out of a few of the 
smaller subcontracted programs. Most sub-contractors JLn the system are 
responsible' for their oWn placement, but the JSO serves as a back«-up placement 
/ * agency for unplaced graduates. The prime, sponsor pays for ES personnel who 
•carry out this placa&ent activity an^ for access to the Job Bank.^ Such a 
mixed system of placement responsibility, where many agencies are Involved, has 
a lot to recommend It because both the JSQ and the sub-contractors recognise ^ 
that they must perform, since there are other agencies In the city that are 
In a position to assume their duties If they do not* 

" The Baltlmdre Metropolitan Manpower. Consortlimi has an Interesting and 

apparently desirable, placement arrangement with ES. Several of t^he 21 
multi-service centers are operated by ES on a sub-contract basis. The service 
centers are Involved In job placement^ as are all the other HSCs, the < 
training subcontractors, and a central marketing unit of t^he MOMR. The ES-run ^ 
MSCs use the Job Bank to secure placements f6r their participants, ^and also ^ 

^ make the Job Bank listings available to all the other MSCs^ In return the job 
openings Identified by the central marketing unit and those developed but not 
filled by the other MSCs are shared with 4:he ES offices. This Is seemingly 
an ideal arrangement for a CETA system In that the Job Bank, while not being 
an exhaustive list of job openings for any area. Is certainly a valuable Job 
development tool, particularly when It Is supplemented by Job openings 
actively sought out by MSG Job dfevelopers and the MOMR's central marketing ^ 
unite 

Improving Private Sector Relationships 

A very effective way to expand the rang^ of job opportunities available 
, to CETA participants is to establish direct links between the CETA system and 
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iployers* Many pirlme sponsors do this In one way or another » but a fev hai^e 
been eapeclally effective In this type of effort « Baltliaore» the labor 
. market advlaory councils (acie bur earlier discussion of them) represent a 
very useful set ot employer contacts^ These contacts facilitate job 
placement activity In three ways. Firsts the feedback the UfAQs litovide on 
staff projections af demand occupatlcxis helps to ensure that only those 
training programs that have a good chance of leading to jpbs are fui^ded. . 
Second.^ ^UMAC members are sometimes able to Identify areais of emp'loyment demand 
that did not shov up In the staff's labor, market analysis. Third, the exposure^ 
to the CETA system that censes with IMAC membership stimulates many participating 
employers to hire CETA clients who complete some of the training programs they 
have had a' hand tn designing • ' 

The Interview boai^ds In Syracuse, which are made up of private sector 
employers (see the section on client Intake and assessment) also end up being 
an Informal means of securing placements for CETA clients » 'The principal 
ftmctlon of the Interview boards Is to give participants sQme experience 
with real Inte^lev situations, but It Is not uncommon for a meoiber of the 
Interview board to offer a job to a participant with whom he/she Is 
particularly Impressed. The senior staft of the OFSAC are. also encouraged to 
be active in the cosmunlty (for example, by serving on .boards). In order to 
spread the good news of CETA to as many employers as possible. 

The Omaha Consortium has always believed In making a very broad-gauged 
effort to Interest meinbers of the business community in CETA. This publlcv 
irela^ibns activity has resulted in many jobs for CETA participants, and is \ 
ackhowledged as having an Important place In the CETA system. The > 
consortium has a formal public relations director as part of the staff, and 
a PR budget. There are three main facets to the PR effort in Omaha. First 
' and foremost it is directed at reaching anployers and informing them about 
the misslbn of CETA, and the trained manpower the program has available. 
This is done In many and varied ways including mailing a newsletter to miembers 
of the Chamber of CoDmierce, media advertising, and even handing- out 
lighters apd keychains to businessmen downtown. The second objective of the 
PR effort is to advertise the presence of CETA to the poal of potential 
clients, and the third is slxoply to maintain a positive Image for CETA in the 
community. Media, poster and. bill-board advertising, and PR newsletters are the 
principal vehicles for accomplishing these goals. Almost everyone connected 
with the system agrees that the PR effort has been a notable success In moving 
the consortium in a positive direction in all three of these areas. 

In Albuquerque the planning staff of the OCETA, work^ closely with 
employers and other agencies in platmlng the location of the skill center. 
They decided to build the center on the site of a future industrial park, 
and then secured a grant from the Economic Development Admlnistraticm to 
make^ physical Improvements on the site in order to lattract industry. The 
skill center .is thus in an l<feal position to train employees for Industries 
locating in the industrial park, which should pay off handsomely in terms 
of future placements. 



The preceedlng discussion has shown that employer contacts lead to 
placements two basic ways: (1) By indicating proklsing areas in which to 
train CETA participants, and (2) by directly hiring either trained or untrained 
participants. This second activity can be taken advantage of by any prime 
sponsor. The first method, however, requires that a prime sponsor have a 
training operation that is flexible enough to respond to input from employers 
in a timely manner. This is a problem for many prime sponsors who, for various 
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reaacna," find themselves to be more or leas committed to a relatively narrow 
range of training progrmsyear after year. Avoiding this kind of entrenchment 
often pays off In terma pPplacements^ , ^ * 

^ The Baltimore consortium has managed to ke^ Its training operation flexible* 
Oaly those sub-contractors loho perform are re^-f unded , and they always come up 
with the money to fund px;pmlslng new tralnliig programa. This puts them In a 
position to benefit fully from the information they receive from the UiACs* 
The same is true of the Penobscot Consortltmi. They have no long-r-term 
commlti^ts to any specific training programs^ and try to design each year's 
set of training offerings to fit their analysis of labor market conditicms. 
Recently the Denver ccmsbrtlum has also decided to jtake full advantage of its 
new system of labor market aiialysis (see the labor market analysis section) » 
by adding a number of new ag^cies ^o their list of training subcon tractors. 
These new agemdes will pf fer training courses in the .areaa suggested hy their 
analysis. * i 

Using Etoployablllty Developm^t Plana J 

' The ef f (Bctive matching of participants to jobs also enhanced by the 
uae of employabillty development plans. Properly used* such plans are a 
vitally important deyice for ensuring, that CBTA participants are thoroughly 
prepared for unsubsldlsed employment in the area for which they have been 
trained, and have e^ery opportunity to make a meanlpgfui career out of 
that employment. Xndeed, under ideal conditions a prime censorship is 
virtually In a poaltion to guarantee Jobs for clients Who successfully 
complete the steps indicated, in the employabillty plan, pbvioualy, CBTA 
prime sponsors rarely operate under ideal conditions » but some^ are V€»:y 
yigllent in trying t;p implement the Ideal model. For example > the Penobscot. 
Consortium not only devotes a great deal of effort to constructing an 
assessment matrix for each participant In order to plnpol&t the gap between - 
each client *s skill and his or her occupational goal, but they also secure 
hiring commitments for the exit compbnents of most participants' employabl^jlt^ 
plans. The Berg^ County CETA staff has also^ enjoyed considerable auccesA ^Ih 
using employabillty development plans Jto ensure that participants coming 
out of ^ the system are in a position to take full advantage of * the Job openings 
that exist In tlie area for which they have been trained. (For a discussion 
of these' employabillty development i^plans see the; section on client intake and 
assessment.) 

Making High Quality Ijlac^ements 

# A final way to promote quality placements is to establish incentives 
within the system that stimulate those .working on placement to make an effort 
to sebure high quality plac^nents* Few prime sponaors do so^ mainly because 
the incentives created by national and regional POL policy work in the opposite 
direction. DOL reporting requirements and c6ncem8 most evident at the local 
level have consistently Ignored long-range Impacts In favor of short-term 
results. 

The Baltimore conaortlum builds incentives for quality placements into 
their performance contracts with agencies operating training programs. A 
typical contract calls for 25Z of the total funding a subcontractor is 0 
scheduled to receive to be paid on the basis of placements. To receive the 
. full 25% the laubcontractor must meet the placement quota contained in the 
contract. Morllover» placements are defined in the cpntracts sis permanent, 
full-time, unaubaidlzedt and training-related jobs at <)r, above a specified 
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wlige. The MOMR 8t«f £ Is the isole judge of 'vhether a job Is or is not trainings- 
related, and the FlT*<im«f^ wige level is set^ by the labor market information 
staff in conjunction with the UiACs. 

The Penobscot Conso'rtlusi employs a sjiollar approach » althotigh with an 
In-house systt^i, It la less formalized. The senior staff and those Involved 
In placement activity have as their working definition of a placement a 
permanent 9 full-*time» unsubaldized, training-related jot» at or above a 
specified wage level that is set by the staff* 

It should be clear that establishing Incexltlves for quality placements 
requires some fsort of verification capability » and if \ retention is to be a 
factor in evaluating the quality of placements » a solid follow-up system 
is needed. The Integrity of the verification process would seemingly be 
best protected If those responsible for verification were Independent of 
the organization responsible for placement* In Baltirore all reported 
placements are independently verified by the MIS unit of the MCHR within 7 days 
after the pi^^ceme^t has been reported. The verification process simply 
involves a check to see that the former participant is working at the wage 
level reported » ^d to secure a statanent from the employer that the Job is 
indeed peonfianent. There is also a regular follow-^p on all termlnees' 30 days after 
they have left tiie program* imd a 6 month f ollow-*txp for selected samples of 
termlnees. " ' 

San Francisco also has a sound verification and follow-up capacity. The 
JSO acts as a verification unit for al^ reported placements and other termlnees. 
The follow-up imit contacts all those ^o were placed » at regular Intervals up 
to at least 1 year. In order to obtain data on ^uch factors as wage gaih» job 
retention 9 axid participant satisfaction. The Penobscot Consortium also \ 
h€is a regular follow-up system that collects even more extensive information 
on all those placed out ojf certain special programs » and a sample of .all 
others, >at regular intervals for at least three years. Their, long-term follow-up 
for a selected sample of participants will extend fior 5 yeara after the time of 
termination. • 
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V. CC»ICLOSIONS 



Our most general finding is that careful planning by prime sponsorship 
^ staff does 9 indeed, have the potential for helping improve program performance! 
At the same time it is quite clear that planning is only one of a number of 
general aspects of prime sponsorship management that needs to be handled * 
adroitly in order to enhance the chances of succeeding with prograomiatic 
goals. The Importance o£^ these general findings. is underscored by the fact 
that the manageo^nt variables (including plasmlng) that can be handled in 
ways to improve CETA perfon&ance are, for the most part, quite manlpulable 
by prime sponsorship staff. Elements of the ^ocal programaatic context — 
. such as economic conditions and demographic characteristics of participants-^* 
are not highly constraining on the kind of perfbrmance that can emerge. This 
means that even under economic conditions that conventional wisdom holds to - 
be adverse to good CETA performance such high Quality performance can, in fact, 
a&erge. It also means that pjlme sponsorships can target their resources on 
the most disadvantaged part of the eligible population as measured by gross 
demographic characteristics without diminishing their potential for good program 
performance. 

This concluding section is kept short both to highlight ^at we think is 
most Important in what we have found and also because detailed findings are 
repot^ted in ample detail throughout the bpdy of the report. The first section 
highlights some of the principal empirical findings. The second section makes 
some broader observations. 



A. MAJOR FINDINGS 

The Effects of Context on Planning Systems 

General contextual f actors ^ are not detexmlnatlve of what kind of planning 
systems emerge in individual prime sponsorships. Prime sponsorships can design 
the kind of planning system they choose for programmatic reasons and are not . 
forced Into a specific planning mode by external factors. 

The general management context in a prime sponsorship is^ however » related 
to the kind of planning system that se^ns most likely to emerge. This is./ 
probably because certain styles of planning fit best with certain styles of 
management. In a sense, management decisions "cause" the kind of planning 
syistem; but in another sense planning emerges along with other features of 
management and the whole package tends to fall into predictable patterns. 
Thu8» "association" is probably a better way of describing the relationship 
between m&nagement context and planning systems than "causality-." 

In prime sponsorships we identified as having future-oriented planning 
systems the associated management variables included a pattern of staff -dominated 
decision-inakingy a stable and high quality staffs stronger than average support 
for staff from political officials » thorough monltoring» and the active 
Involvement of the private business sector. 

In prime sponsorships with operations management planning systems there 
was more likely to be less staff domination of decision-making (usdally 
involving significant sharing of influence with service deliverers) , more 
turnover in key staff ^ low involvement of business ^ and less well-^developed 
monitoring systems. 
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Explaining Program Perf oraance 

Management cluaracterlstics and planning both have stronger Influence on 
per£omance than any contextual variables. This is a very encouraging finding 
in that this oeana that prime sponsorships— particularly the staff — ^have the 
latitv(4e to focus on Banagement decisions and planning, over which they have 
considerable control, in order to improve performance. Conventional wisdom 
that suggests that economic conditions and d^ographic characteristics of 
participants determine or at least hi^ly constrain performance simply finds 
no empirical support in our work. ^ 

The factors we found to be most strongly associated with better performance, 
were the quality of staffs the nature and extent of business involvement, and 
the quality of monitoring. Prime sponsorships not satisfied with their 
program performance would be well-advised to consider their activities in 
relation to these three areas first. The body of the report contains some 
specific suggestions of steps that might be taken in ^ach of the areas to 
improve conditions that would, in turn, have a salutary effect on performance. 

gcemplary Approaches to Critical Elementa of Plaimlnis and Management 

Giyen that a variety o£ manageiaent and planning factors were found to 
affect program perforaance lie thought It vorthiifaile to spell out . In 
soae detail specific Instances of approaches to scne key eleiaents we had observed 
to be working iiell. It needs to be underscored that ve do not find a single 
"good" vajr to approach any of these eleai^ts. Bother we found a number of 
seemingly productive approaches. And» with adaptations appropriate to 
specific local necessities and conditions, we think some t>f these approaches, 
deser^it publicity because they may well merit emulation in spirit If not In 
every detail. Diffusion of productive approaches within tne CETA system seems 
both possible and eminently desirable to us. 

* Ve provided what we considered to be good examples of productive 
approaches to seven elements of planning and management: 

1. Manpower planning councils • 

♦ 

2. Monitoring and evaluation. 

3. Universe of need and target group identification. 
« 4. Intake and assessment strategies. 

5. Labor market analysis. 



6. System design (service deliverer selection, service delivery systems, 
and performance contracting). 

7. Participant placement strategies. 

r 

Our "findings" in this area cannot be readily summarized except to say 
that \ie found multiple examples of productive activity in each area. The 
text of Section W contains considerable detail w 
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B. OBSERVAIIONS AND IMPLICATIONS 

la There One "Best" Model of Planning? 

We have Identified three laodels of planning In this report: Future-Oriented. 
Operations Management, and Crisis Management. By Implication there Is a fourth 
model: No Consistent Planning. We think there are hlg^ progrannatlc costs for 
a prime sponsorship that adopts the No Consistent Planning Model. We also ^see high 
costs to deliberate pursuit of a Crisis Management Model or. more to the 
point, continued toleration of conditions that lead to the necessity of adopting 
a Crisis Management Model. But we do not argue that Future-Oriented planning 
Is necessarily superior to Operations Management planning In all cases at all 
times. V 

* Clearly, the Crisis Management model characterizes a system that all 

prime sponsorships should try to avoid. Unstable Influence patterns, unmanaged 

conflict, and Inoperative feedback processes are all marks of a system In 

r chaos that can have little hope of fulfilling the substantive goals of a 

CETA program. However, while prime sponsors would certainly rather be In an Opera- 

tloiis Management or a Future Oriented system. It Is not the case that the Future 

Oriented model la preferable to the Operations Management model In all cases. 

contexts, and times. For example, at a certain point In a prime sponsor's 

development. It may be that most long range goals have been sufficiently 

dealt with so that the ^continued extension of organizational resources Into an 

ongoing Future Oriented part of the staff may be Inefficient. The prime 

sponsorship may make the best use of resources by focusing Just on ongoing 

programs within annual plans. At some later point It may be efficient and 

Important to add the features of Future Orientation to the existing accomplishments 

of the Management Operations model, hold the Future Orientation In place long 

enough to Inject additional planned change Into the system and Institutionalize 

it. and then revert to the Operations Management of the now Institutionalized 

gains. Thus, we believe the two models accomplish somewhat different 

purposes, and a prime sponsorship staff can consciously shift between the 

two models of planning according to local ne^ds and priorities. 

» 

There are not only one or two "good" sets of planning activities (and 
related influence structures) that should be adopted in all ^rime sponsorships 
in all contexts. Some types of planning activities and some types of Influence 
structures will be effective in some contexts while not in others. 

For example, a very sophisticated, highly quantitative monitoring system 
may be essential for good planning and decision-making in a large prime 
spohsotship with numerous serviceMeliverers. Yet. in a much smaller prime 
sp'oiisorship. one with only one or tWo service deliverers, a monitoring system 
based largely on qualitative information, on a J^ess rigorous basis may work 
quite well and resources may,^ in fact, be wasted on a more sophisticated 
system. However, if no monitoring system exists and there is no feedback to 
decision-makers on how well programs are operating, then a judgment can be 
made that the planning system is not functioning effectively. And to the 
extent that planning is Important for good decision-making, then the decision- 
making process could also be judged to be poor. 

What dets Planned ? « 

We found that four major areas are the focus of planning efforts: (1) target 
groups in the 'population. (2) target occupations. (3) progrdn mix, and (4) service 
deliverer identity and responsibilities. 
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Most of our sites wece quite self-KSonscious about planning for selection 
of their target groups, miere there was an active public process it was 
invariably iised on this question. Different methodologies were used for 
identifying t^get groups. The wisest strategy seems to be to keep the 
definitions of target groups broad rather than using elaborate matrices that 
result in very small discrete categories. Broadly Inclusive cfitegorles seem 
easier to work with both operationally and politically . 

There was considerable attention to occupational planning in about 
half of our sites. These prime sponsorships did a thorough and Impressive 
Job of working with all kinds of data on target occupations. Spending lots of 
time and resotirces in this area seems to make particularly good sense if the 
system is flexible on a short-run basis, so that it can respond to short-run 
occupational opportunities that are identified. If the structure of the system 
and/or political reality prevents much short-run change, then less attStlon to 
target occupations may well be varranted because it might turn out to be 
"rlmarlly an academic enterprise. , ^ 

Where there are subcontractors, program mix and the choice of service 
deliverers are usually planned or addressed together, vlth each being 
a function of the other in a chlcken-and-egg relationship. Where much or all of 
the delivery is In-house or where a good deal of individual referral is done 
or vhere subcontractors are closely managed^ then there vas a greater tendency 
to think of program «lx questions prior to worrying about the details of 
service deliverer identification. But, particularly vhe;re there are strong 
community-based organizations vlth Important local political support, the 
identification of service deliverers — and, to some extent, what they deliver— 
is almost a given.. 

It is also vorth noting that all planning systems ve have observed focus 
virtually exclusively on- CETA matters. Even in the future-oriented sites ve 
did not observe systematic integration of CETA planning vlth coamunlty develop- 
ment planning. In short', CETA planning focuses only on planning activities 
vlth relatlcm to the supply side of the labor market; planning linked to 
non-CETA programs vlth concrete actions on the demand side of the labor market; 
is still largely virgin territory. 

WhirfC Promotes and Impedes Effective Planning? 

7 '■ ' '■ '. 

Five major conditions promote effective planning If present and impede 
effective planning if absent. 

First, goals are essential. These need to be self-consciously addressed 
and articulated. And this process needs to be repeated; it cannot be assuaed that 
goals will be internalized If announced only once. Lack of clearly articulated 
goals or the presence of goals that are almost all implicit can create i)roblem8 
in bo'th planning and, ultimately, in performance. 

' <» 

Second, some form of public planning process or allowance for major 
input from actors outside the staff is very useful in promoting planning 
decisions that are responsive to conditions in the "real vorld" and also in 
promoting decisions that. are widely accepted as legitimate by the major actors 
in the system. Most of our sites have chosen to make their advisory council the 
centerpiece in a public plqpning process. 

Thii^, both good monitoring and well-developed Management Informatldn 
Systems (MISX are essential for linking planning to operations and using 
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both In concert to Improve perfonance. Evaluation la more rare, but where it 
exists It is a useful addition to the basic monitoring and MIS -activities. 

Fourth, and perhaps, most Important in terms of being a prelude condition 
fojiTmany of the others, prime sponsorships need to be very self-conscious In 
developing a solid staff — ample In number, veil-train^, willing to stay with 
the Job at hand for a period of some years, and comnltted both to making the 
program succeeii In general and to some concrete programmatic goals. . 

Fifth, the CETA staff needs to have a productive relationship with its 
subcontractors. Where those subcontractors are strong performers with a strong 
Independent political base this relatiqnship may well have to be based on 
negotiation and compromise aimed at creating a '^family feeling" #bout the 
idiole system. 

The continuing categorical expansion of CETA has put up some roadblocks to 
planning, especially in terms of integrating different CExA programs into a 
comprehensive whole. However, a high level of determination to achieve 
integration can still have a high degree of payoff . 

How Important is Planning to Ferformance? 

We have found some aspects of planning to be related systematically to 
some aspects of performance. These concrete findings should not be overblown 
in(to a claim that planning is the key to good performance. There are many 
oUier elements of management that are also critical in developing the capacity 
for good performance In a local CETA system. Planning is not a panacea; it is 
Important. Fortunately, there are concrete ways to strengthen planning — it is 
not Just a matter of engendering positive attitudes toward it on the part of 
a staff. The central point of Section IV of the report was to specify some 
of the concrete- options available to prime sponsorships in a number of bqth 
planning and broader management activities . 

In the broadest sense, the fact that manipuiable aspects of planning and 
management have been found both in this study and in our 'earlier work (Ripley 
and associates, 1978) to be related to the quality of performance is highly 
encouraging. There is nothing magic about decentralized emplojment and training 
p:(ograms that makes them work better than other kinds of programs. But there 
is solid empirical evidence that local prime sponsorships can make specific 
choices that will have desired prograinnatic effects. They are not" caught in 
a mechanistic situation in which their efforts are automatically overridden 
by fluctuations in matters over which they have no control, such as the general 
economy . 
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APPiaiDIX: HRIEP DESCRIPTIONS OF THE STUDY SITES 



Note that these -descriptions apply to the time of our field visits — 
either spring or susmer, 1978 (see Table 2 in the text). The sites are in'- 
alphabetical order. 

ALBUqpERQUE-BESNALILLO COmTTC CONSORTIDM, NEW MEXICO 

The Albuquerque prime sponsorship is a consortium involving the City snd 
, the County In which it is located. The City,^ which contains over 70Z of the 
population In the County, has-been given the responsibility of administering 
the CETA Program. 

Since 1976 Albuquerque's unen^loymemt has been higher than the national 
average. The City has been paralleling the national eoq>loynent picture recently 
by e3Epexienclj;ig a significant drop in its xmemployinent rate since it peaked 
during the second and third quarters of FY 1977. 

Albuquerque is an area of grovlng population with a large niunber (302 
according to the 1970 census) of Spanish sumasaed o^tlasena* The census 
Indicates that black poptilatlon is suspected of having Increased It^ proportion 
since then. >lbre recent data indicate that Spanish sumasned individuals 
comprise 44% of those onessployed , ^ile blacks and American Indians are 4% 
each. Ethnic groups have not been designated as significant segments but are 
served in accordance to their proportion of the ecotumlcally disadvantaged 
universe of need. The signlticant segments that have been identified are: 
elderly (45 and over), handicapped, offenders, and youtii.* 

Staff has been dominant in d^^rminlng the basic features of the Albuquerque 
Title I program. In large partT^diis may be attributed to the fact that the 
staff is composed 'of an unusually large proportion of individuals who are 
clearly manpower professionals^ and whose experience pre-^tes CETA. . In part, > 
staff dominance can also be explained by the lack of any effective opposition 
to them from either elected officials, the Planning Board, or service deliverers. . 



There have been only slight changes in the Title I program (participants, 
program mix, and service deliverers) ovexf the past few years. This situation 
clearly reflects the staff goal of stabilizing the program and building up 
the capability of existing deliverers. It also reflects the £act that, 
according to the standard indicators, Albuquerque has been running a very 
successful program and so there has been little Incentive to institute major 
changes. Operating a good program, one that performs well given such standard 
indicators as placement r^te, was identified as the most Important goal held 
by the Albuquerque CETA program. 

The typical Title I planning that takes place in Albuquerque consists 
of incremental adjustments made in response to operating problems that have 
been identified. Albuquerque was engaged in some long term planning in the / 
past, but none can be said to be taking place now, although re-establishing this 
capability Ig^^clearly a goal of the new CETA Director as is revitalizing what 
has been a "stafT dominated Planning Board and thereby opening up the planning 
process to greater public input. ' ; « 
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Ab Indicated^ 'Albuquerque has done well on the standard program performance 
aeaaures such as planning rate, non-positive terodnation rate, and cost per 
placeiaent. The recent redefinition of an indirect placement has caused 
performance on the indirect placement rate and cost per placement Indicators 
to drop during the second quarter of SY 1978 but the prime sponscir has taken 
corrective action fnd hdpes to finish the year meeting its goals in these 
areas. High goal achievement has been achieved without sacrificing service 
to tHose participants determined to be most in need. 
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ilUNXA, GEOBGIA 

The City of Atlanta prlne sponsorship exists in a region dominated by 
tiie wholesale and xetaln trades yhere 60Z of those eaployed hold white. collar 
jobs. Atlanta has suffered a hl^er uneoployiaent rate than Its neighboring 
suburbs and counties. The un^loynent rate for Atlan^ has also been 
hl^r than the national average. 

Atlanta has bean losing Its white, middle class popu]<«rtlon to the 
8ubur)>s. (Jobs* too, have been moving In this- direction.) In 1960, for 
example, blacks were 392 of the City's population. By 1975 It Is estimated 
that this figure was 60Z. As might be expected, ,Atlanta*s blacks haye a 
- much hl^er uneaqploym&nt rate than the white population and comprise 81Z 
of those unemployed. 

The most outstanding feature of the Atlanta prlne sponsorship is the 
openness of Its declslonr-maklng process to the Input of a wide ifange of 
Individuals and organizations . Decisions f re typically made on the basis of 
what Is perceived to be the best available Information. Influence Is shared 
among the staff, the advisory council, service deliverers, and the Mayor, 
although usually the staff position Is dominant. 

* - The'CETA office staff Itself Is generally competent and well- Motivated. 

However, there have been Important problems with Title I MIS and with the , 
Fiscal Unit, and the Evaluation and Planning Units have been understaffed. 
Improvements are being made or are planned for all of these ar^eas. 

Only sll0it variation has occurred since FY 1975 In the allocation of 
resources and participants among program components. The most noticeable 
exception appears to be decline In the proportion of clients enrolled In 
classroom training and 9x1 Increase In work experience. Most major contractors 
(chosen annually via a Request for Quotations process) were picked up from 
the pre-CETA days and, have continued to be Refunded. More change has occurred 
among the smaller deliverers. ^.^ . 

Long-term planning cannot be said to exist In Atlanta. The planning that 
does take place is short-term and is focused on the Title I grant application 
process sad the selection of service deliverers. Service deliverer selection, 
which actively Involves the advisory council and staff, usually also determines 
target groups, target occupations, and program mix, although the advisory 
council does Independently look into these areas. Incremental rather than 
radical change has been the result of ; the planning process used in Atlanta. 
Of^en, this change has been stimulate^ by reaction to poor program performance, 
especially lack of placement, by the iervlce deliverers. The monitoring and 
evaluation efforts (especially the foi^r) of the CETA Office have been instru- 
mental in identifying many of the problems that have led to change. 

Atlanta's placement rate has typically been above the national average» 
Just as its cost per placement has been lower. Non-poMtive terminations, 
on the other hand, have been above the ^tlonal average. Atlanta's planned 
versus actual figures have been generally about the same with the exception 
of the non-positive termination rate and expenditures, which have lagged 
behind estimates to the point where a $1.25 to $1.5 mllUon underspending 
problem developed. 

Locally established goals hive been pursued successfully' with the goals 
of infusing more innovation Into the system and developing a more integrated 
manpower delivery system being the .exceptions. 

ER|c 307-7.6 0 - 80 - 9 1 3 



Atlanta has tended to serve Its chosen target groiqps, but the choice 
of groups Itself has tended to reflect previous, successful service patterns < 
V The typical client served In Titian ta Is black, unemployed, and economically 
disadvantaged. 
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BALTIMORE METROPOLITAN MANPOWER CONSOR'^HIM, MARYLAND 



The Baltimore Metropolitan Manpower Consortium (BMMC) consists of the 
city of Baltimore and Anne Arundel, Baltimore, Carroll, Harford, and Howard 
counties. The consortium coincides with the Baltimore SMSA, which includes 
a population of nearly 2.2 million. Almost 70% of the population in tlje 
consortium resides in the city of Baltimore and Baltimore County. Twenty-six 
percent of the population in the consortium is non-^hite, but 53% of Baltimore 
city^s population is non-white. A majority (60%) of the consortium's poor^s 
located in the city of Baltimore. The overall rate of unemployment in the" 
consortium has remained fairly close to the national average, but the rate of 
uneiiq)loyment for non-white youth has been quite hi^ (averaging over 17%). 

The BMMC has benefited greatly from having the principal features of its 
delivery system in place before CETA was enacted. The program is administered 
by the Mayor's Office of Manpower' Resources (MQMR), and many mettbers of thfe^^ 
senior staff of the MOMR worked, together under CAMPS to design a comprehensl^ ^ 
delivery system for the consortium. Experience and stability in the senior 
staff has been S^ery important in the development of predictable and stable 
relationships among manpower actors, ^d in the recruitment of other sophisto- 
cated manpower professionals into the Itt)MR staff. The combination of an 
experienced staff and a stable delivery system *^as a lot to do with the success 
enjoyed by the BMSfC under CETA. 

With an effective delivery system in. place, planning in the BMMC has taken 
on an operational orientation. While all four t^pes of en^jloyment and training 
programs (WE, CT, OJT andf PSE) are operated under Title I, the bulk of the 
planning activity focuses on the training programs. Planning for skill training 
programs is greatly aided by a network of labor market advisory councils (liiACs) 
that have been established to supplement the information generated by the staff 
on prime sponsor training needs and performance. The skill training programs 
are subcontracted to* a variety of public and private training organizations, 
while all other programs are . operated in-house.. 

Most CETA services are made available to clients through' a series of 
manpower service centers strategically located to se^rve the entire consortium 
area. Job development activity ifi shared by a central marketing unit. Job 
developers located In the seirvice centers, and job developers assigned to the 
training subcontractors. All placements are verified by the MIS unit of the 
MOMR. The MOMR uses a system of performance contracting' to guarantee thait. 
. all subcontractors are meeting the performance goals established each year 
through negotiations between the staff and the subcontractors • Quality 
performance is further insured by an extensive monitoring and evaluation 
effort, which is backed up by a solid MIS. The evaluation unit is also 
continuously studying various aspects of program operation and performance 
by conducting both short term stijdies of pr^Dgram outcomes, and long term 
follow-up evaluations of CETA programs. * ^ 

The standard program performance indicators demonstrate that the BMMC is 
operating a strong program. Placement rates have been consistently above the 
national average, and non-positive termination rates and costs per placement 
have steadily decline^* This has been accomplished without moving away from 
serving disadvantaged, which has always been a primary goal of the BMMC. The 
staff believes that this record of performance is linked to their continuous 
efforts to improve program operations through systematic planning. 
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BERGEN COIIHT?, !^ JERSEY 

The Bergen Oounty , New Jersey, prime* sponsorship has a- population of 
arotmd 900,000 people-.' Most of th^ (97%) are vhlte and relatively wealthy; 
die county Is aaong the wealthiest In the nation. But there are obvious 
pockets of poverty spread through this large county separated f ron New Ybrk 
City by the Hudson rlveif. The county *1a umeiqployBient rate has often 
been higher than the national average over the last three ye^rs. 
• ' ■ 

The single most Important feature of tiie prime sponsor's organization is 
that the entire CETA program is operated by the Bergen County Community Action 
Program (BCCAF) under a contract with the County's Board o£ Freeholders — an 
arrangement made at tbe beginning of CETA. The BCCAF staff operates most 
CETA programs In-house through three multi-service centers v^ere clients 
recei've Intake^, assessment, counseling. Work experience, job placement, and 
job development services. Only, classroom training 'for skills or educational 
laproveiBeht is subcontracted. The system of in-house operation, a central 
goal of the prime sponsor, staff since the beginning of CETA, has .been 
largely accomplished. 1 ' 

' ' , " ' . '■ 

Primary es^hasis'^in t^e Title I program is on training programs in the 
classroom or througli OJT. LiiftLted resources are devoted , to work experience 
programs.. Over tlm^ .the preference for classroom Craining and tiie aversion 
f or , work e:q^erlence has>be<fome manifest In larger coipd-tments of program 
funds to the ^forsier and less for tiie latter. * . 

Bergen County's staff has an operationally-oriented vie*r of planing. 
The planning unit places its Emphasis on continuous, cooperative work with 
the opexrations staff to isprove program perforaiance. Its priticiple strengths 
are in the areas of system wide 'development and program ccnponent monitoring. 

The ins has been weak because of continuing probl^as-wlth -a -faulty. 

computerized system. The poor MIS has pro|ilblted the staff from conducting^ 
program-outcome evaluations, but client satisfaction questionnaires, on-site 
reviews, and other forms of monitoring are regularly conducted by the staff 
and the advisory council and are utilized in program decisions. ' 

The standard program performance indicators demckstrate that Bergen *ls 
operating a steadily improving program, the results of which are ^Ically 
better than the national average. Across the three years of complete operation, 
the placement 'rate has Increased 182, the non-positive termination rate has ' 
improved by 16Z, and the cost per placement rate has Improved In 
general it would seem that this has been accomplished wltiiout creaming for 
the best applicants. The staff feels that these inprovements are linked to 
their continuous efforts to lsq>rove program quality and operations through 
systematic planning. 
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DENVER, COLORADO , - — . 

The Denver prlsie sponsorship encoiq^asses cmly the city and county of 
Denver (they are co-teroitnous). It has ahout one-*thlrd of the population 
of a larger labor market and a diversified econosBy that Is not reliant on 
heavy Industry and taanufacturlns- Denver^s unettployment rate, although higher 
than surrounding suburban counties, is lover than the national average • 

The population Is composed primarily of Anglos, with two large minorities— 
Chicanos (17Z) atid blacks (9%). CETA significant segments inplude Chicanes, 

blacks, economically disadvantaged, women, heads of household, and veterans. 

\ 

The Denver Manpower AcbalnlBtratlon (DM^) staf£ la larg^ and has grown 
yery rapidly since iald-197d. The staff has been wracked by turnover, especially 
^t top levels, and by long-term vacancies. The planning staff has gro»m from 
one consultant In July, 1977, to seven professionals In i^rll, 1978. Except 
for the chief planner, the staff Is relatively Inexperienced. The MIS unit 
In DM^ has been particularly plagued with problenjs that have prevented the 
unit from functioning. 

There has been little substantive change in Title I manpower prpgrams 
In Denver since pre-^ETA days, althou^ there have been some procedural 
•change^ most notably the Intrcfductlon of an R£T for the selection of 
^service deliverers for the F7 77 program year. Program mix has been relatively 
stable over -time and eiq>hasla!es counseling and assessment services for 
clients and, to a lesser extent, classroom training (including adult basic 
education). There has been little OJT or work experience. The identity of \ 
the major service deliverers has remained cons tan t,\ althou{^ a few hew ones 
have been added since the introduction of the, RTF* 

The amount and quality of planning for FY 78 weWe severely limited by 
operational problems that demanded the time and attention of ,the planners. 
Piaxining activities that have' been relatively 9trong are 1) the analysis 
of thfe ionlverse of need and target group selection and 2) the analysis of 
occupalional opportunities. Planning has beeQ espec'iaaly weak in relation 
to decisions about program mix, which has emerged simpJhr as a function of tfid 
deliverers selection, planning has also been severely naiapered because very 
little monitoring has taken place for over a year. Because of the lack of 
monitoring, MIS, and time no evaluations of programs have been done. The 
Involvement of the advisory' council in planning has been\very limited and 
was under close control of the DMA' Administrator until iTy78. At present the 
planning staff is trying to support the development of an Active and 
influential council. 

Denver's program performance has been strong in the area of reaching 
target groups, which contain those individuals most in need) However, there 
are a nusi>er of weak areas in Denver's performance: placement has slipped 
recently, even though most placements are direct; the non-*positive "termination 
rate has remained fairly hlg^; and very few participants are being served with 
vocationally-related training in a system tiiat is currently spending over 
$3.5 million annually in Title Iv Local goals— other than organizational 
survival — are not stated clearly anid widely understood and shared. Assessment 
of the quality of program performance is possible until the MIS system la 
functioning reliably. 




GUIF COAST MAMPOHER CONSOSTIIJM, TEXAS 

The Gulf to&at Manpower Consortitsn (6CMC) Is conprlsed of eleven 
cotmU^: Austin, Brazoria (the eligible prime) » Chaaibers, Colorado, Fort 
Bend, Liberty, Matagorda, Montgooery, Walker, Waller and Wharton. All of 
the counties are meabers of the Houston-Galveston Area Coyncil (H-GAC), 
which serves as the administrative am of the consortium. The cdibortium 
was formed in FX 76; prior to that time the counties vere vlth the Balance of 
State opei^tion. 

The area's econoaiy, greatly influenced by the vigorous growth in Houston, 
is robust. The unemployment rate in the consortium has been under the 
national I average by a substantial margin. The forecast is for continued' 
growth*. Manufacturing and cons true tiQn are scheduled to escperience 
.substantial expansion. 

The GCMC has two large minority groups. Blacks and Chicanes. They C 
cos|>rlse 17% and IIZ of the population, respectively. CETA significant 
segments include disadvantaged youth, alder workers, veterans, handicapped, 
■minorities, female heads of households, and working poor. 

There has been very little ^±ange in the Title I manpower program since 
CETA' a inception. Wqlrk experience, especially directed toward youth* 
classroom training^ and a small OJT program coiq[>rise the Title I program. 
While the substance of the program has not undergone much change,' the /node 
of 8§rvlce delivery has changed. In the consortium's first year of operation, 
each service deliverer performed its own Intake, assessment, Job deve^pment 
.and placement operations. Those activities were subsequently given to the 
Texas Employment Commission (TEC). CETA funds a nuisber of Manpower Service 
Centers throughout the consortium, staffed by TEC personnel, to perform 
these functions. 

A Request ^or Proposal is used for Title I. The GCMC is devoid of many 
potential deliverers of CETA services^ due to its rural orientation. As a 
result, the same deliverers have been a part of the manpower delivery system 
since the beginning. Only one deliverer, 'SER, has gained entrance into the 
system since that time. 

The planning for Title I is reliable in nature.' The shortage of reliable 
data for some counties in the consortium precludes a planning system based 
on highly quantifiable inputs. The. staff supplements the data that are 
available with a thorough knowled^fe of the service area. Field representatives^ 
visit service deliverers frequently; this type of informal monitoring compensates 
for the fact that only one program monitor is eiq>loyed by the GCMC. Planning 
has been traaitlox^ll^ a staff function with only limited Input from the 
Manpower Advlsoty Committee. There are signs that the Committee is becoming 
more active. 

GCMC* 8 program performance has been quite good. Placement rates have 
✓ surpassed tbe national average. The qon-positive placement rate is very low 
as a result of aggressive efforts on the part of counselors to keep track 
of participants who -have dropped x>ut of courses. Often these individuals 
find employment on their own and are not counted as non-positive terminations. 
The prime sponsorship has a commitment to serve the disadvantaged; 75X of 
Title I participants are mandated to be economically disadvantaged. 
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HEAKTLi^ MANPOWER COetSORTIUM, FLORIDA ' 

^ The Heartland Manpower Conaortlum (HMC) la coaq>o8ed of five 'contlguou£| 
counties located In the veat central, portion of the atate of Florida: Folic, 
Highlands, Hairdee, DeSoto^and Okeechobee. • llie population of HMC Is 
approximately 400,000, of which 74Z reside In Polk County. Highlands ranks 
second with 112 of the population and the other three counties each conprlse 
52. HMC*s quarterly- uneiaploynent rate Is consistently higher than the 
national average. Significant seasonal une]Q)loyiBent Is the most distinctive 
feature of the econooQ^; the predominance of the citrus Industry Is responsible 
for the fluctuations. Citrus production and phosphate mining constitute the* 
major Industries In the area. 

The racial nix of HMC la 83Z white, 172 non-white. Blacks are the major 
-non-white group In the ar^a, with Spanish-Americana and American Indians 
comprising a small percentage of the total population. Age Is a significant 
factor In the composition of HMC* a population. Persons 65 and over constitute 
16Z of the area's residents, reflecting the tendency for retired persons to 
settle In warm southern climates . Older workers are a significant segment 
Identified by the prime spo^or. Youth, minorities, veterans, and migrants 
are also consldeored to be ^ need of CETA services. - 

m 

HHC*8 Title I program has not experienced much substantive change since the 
program's beginning/ The three major service deliverers remain In place; 
they have been Included In the delivery system since the program's Inception. 
Some service deliverers have been defunded^ primarily those Involved In pilot 
projects. Significant changes ixL the jprogram are forecast jlf the staff acts 
on its stated intention o& reducing its reliance on sub-contractors and 
operating the program in-*house. 

Work experience has been the dominant Title I activity. Aa In-School 
program^ and a very popular Seniors-At-Work program coiaprlse the bulk of work 
experience activities. Classroom training, now receiving 40%* of Title I 
funds, is often used in conjunction with work experience. Participants are 
'enrolled in work experience after conqpletlng classroom training to enhance 
their ehances of obtaining imsubsidized eiqployment. • 



The public planning process is as important as technical planning in the 
Heartland Manpower Consortium. The imaginative use of the Manpower Planning 
Advisory Council and its siibcommlttees is the heart of the public planning 
process. A flexible subcovanittee structure enables the staff to obtain a 
wide variety of input from individuals with e:q>ertlse in a manpower relevant 
field. The sd>commlttees are as follow: Needs Assessment of Clients, Youth 
Council, Proposal Review and Evaluation, Vocational Training, and Public 
Service Employment. The MPAC, whose chairman is an ixnportant elected official, 
works closely with the staff in all planning stages. 

The prime sponsor's performance has been iiop roving. The placement rate 
has steadily increased. The non-positive termination rate has fluctuated 
widely but has b^en showing some Isqprovement. Thie H^rime sponsor's cost per 
^ placement compares quite favorably with t±ie national average. Service to 
the economically disadvantaged has been on the increase. Females have been 
steadily Increasing as a percentage of Title I participants, while Title I 
service' to non-whites has ^een decreasing. 
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KIN6-SN(fflOMISH MANFGWBR CONSOBIIISf, WASHINGTON 

'^'^ The KSMC prime sponsorship encoinpasses a two-<:ounty.area. Seven cities 
In addition to the two counties are' members of the consortium. The consortium 
Is also a single SHSA and ftan be considered as a single labor market, although 
there are many smaller labor markets within the area. The labor force is 
hi^ly educated, highly skilled, and highly unionized; The economy is diversified. 
|foemployment« which had been well above the national average, has dropped rapidly 
and the economic outlook for the area for the iisDedlate future is relatively 
bright. . 

The population of about 1.4 million people is primarily white. In the 
.labor force 3.4Z are black, 2.8X are Asian, and 2.0Z are Spanish American. 
The minorities receive a high degree of service from CETA. Current significant 
segments are limited to three broad categories: minorities, females, and youth. 

The KSMC staff has about doubled in size to 70 in the last two years. 
In genc^ral, it is an able, experienced, and well-educated staff. Turnover in 
the last year has been relatively high. This turnover has Included three 
division directors as well as the overall Director. The new Director took 
office in late 1977, replacing the former Director who had left in Septeodier, 
1977. The Planning and Analysis unit has 12 positions and works very closely 
With the Program Design and Administra|ion unit, which focuses on operations 
and has 14 positions. 

The Title I manpower delivery system has been relatively stable througjiout 
t&e CETA period. The major deliverers have remained the same although some 
marginal and small deliverers have been replaced. An RFP process is rarely used. 
Given at least moderate performance it is assumed that funded deliverers will 
be refunded. Over time the classroom training component of the program in terms 
of both dollars and participants has increased and the work experience component 
has shrunk. 

The ataff thinks of plaxmlng In two senses: short^run, operationally 
oriented planning (that also Involves grant writing ancL maintenance) and long- i 
run, strategic plaxmdtng. Moat effort has been e3q>ended on the fonaer 
enterprise and the latter enterprise has been given relatively little^ attention, 
in part because of the necessities of dealing with a manpower system that is 
rapidly being recategorized from Washington and in part because of lack of < 
data sophisticated enough co meet the planning staff's high standards. The 
presence of a relatively new Director, whose own values an^ preferences are not 
y«^t clear to staff or other actors, alsoN inhibits long-range planning. 

Both planning in the shbrt-riin sense and the use of a widely' accepted 
public planning process are well developed in KSMC. The prqcess involves a 
nusd>er of actors: service deliverers, subconmittees of the advisory cfounc lis, 
two advisory councils (one for each cotinty), the staff, a subexecutive committee, 
and the Executive Board (elected officials) of the contortion. This process 
serves to diffuse Information about CETA, get some feedback from the various 
segments of the community, and make virtually all decisions widely accepted 
as legitimate. There are- some uncertainties In its use for FY 79 because there 
' are a number of new persons in critical positions. Formal planning for FT 79 
has been postponed because of the unknown funding level for FY 79 and new 
provisions likely to be included in CETA reauthorization that cannot be fully 
predicted. 
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The planning by staff has been particularly strong In terms of Identifying 
target groups. The capability of the staff to affect performance is enhanced 
by the existence of a strong monitoring effort axid the close relations between 
the planning and operations staff. Goals are mostly implicit and the new 
Director has not yet altered or added to those goals publicly, although he 
favors expanding CETA— non-CETA linkages, especially with economic development. 
The choice of service deliverers helps determine service mix, althoug^i the 
general conmitment to' classroom training and OJT helps determine the, choice of 
deliverers. There is relatively little systematic attention given to identifying 
'job opportunities by the KSMC staff— job development and placement is given to 
Individual deliverers. 

Program performance has been improving and has been quite strong in the 
last several years. Long-standing local goals (although in part implicit) are 
being achieved. These include maintaining the consortium, maintaining the core 
of the existing delivery system, and focusing on placement of the most disad- 
vantaged. Htnorities, females, and l:he disadvantaged receive heavy attention 
In tKe services that are delivered. Placement has been increasing, although it 
is still not dramatically high. A previously hig^i non-positive, termination rate 
has been reduced substantially and is now well below the national average. 
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CMAHA—COMBINATION OF GOVERNMENTS CONSORTIUM, NEBRASKA 

The city of Omaha — Combination of Governments consortium Is comprised 
of the city of Omaha, the balance of Douglas county, the city of Bellevue and 
the remainder of Sarpy county. Population In the consortium la estimated to 
be 585,000. The city of Omaha, the largest metropolitan center In Nebraska, 
and the remainder of Douglas cotinty constitute over 90 percent of the 
consortium's population. The two-county area of Douglas and Sarpy county has 
a racial composition of 90.5 percent White, 8.1 percent Black and 1.4 percent 
other minorities. 

. The Omaha economy Is an economy In transition. The emphasis is shifting 
away from exclusive reliance on manufacturing to include service-oriented 
industries. While the transition has prompted significant upheavals, the consortium 
unemployment rate did not exceed the national average. Moreover, the Omaha " 
economy staged a quicker comeback from the recession than many prime sponsorships. 

Omaha has long been the host to manpower programs. A CEP was in operation , 
prior to CETA's Inception, dnaha was one of the three original prime sponsorships 
selected for pilot projects in the Comprehensive Manpower Program (CMP), the 
forerimner of CETA. The existence of these manpower training programs has aided 
the prime sponsorship in a number of ways. They created a reservoir of exper- 
ienced manpower specialist^ many of whom are still involved in CETA. The 
heads tart provided by the CMP status enabled the prime sponsorship to wage a 
n«mb«st- of consolidation battles early in the life of the program. While 
Itiexperienced staff in other prime sponsorships were in the initial trial and 
error design phase, the Omaha staff knew the capabilities and limitations of its 
manpower delivery system. 

* 

The consortium's Title I program has, experienced substantial change since 
the ptogram's beginning. In general, changes have been in the direction (% 
centfralizing services previously sub-contracted to other deliverers. Intake 



been centralized; the prime sponsorship does much of its own assessment, 
orientation, education, job development and placement activities. Those functions, 
pigmarily training, performed by service deliverers are closely monitored. 
Cbtitracts written with service deliverers contain performance standards and 
are of a cost-reimbursable nature. 

" • 

A highly quantifiable planning system eights in the consortium alongside 
a more intuitive model. As the latter ^is usl^at the highest level of the 
organization, it giyes shape and content to planning steps performed by the 
Planning unit. Th6 philosophy of the strong Director and the rigorous approach 
of the Plinning unit mesh to ensure that both political and more technical 
•manpower planning are represented in the consortium. To date, the Manpower 
Planning Council has not been an important partner in planning but there are 
indications- that the involvement of the Council is increasing. 

The prime sponsor's placement rate has shown steady improvement. It 
compares favorably with the national average. Due to the open intake policy, 
the non-positive termination rate has been higher than the staff would like 
but it has shown improvement in recent quarters. The prime sponsor's cost 
per placement generally has been below the national average. 
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PENOBSCOT CONSORTIUM, MAINE 

The Penobscot Consortium includes Penobscot and Hancock counties In the 
state of Maine, and operates under the authority of an Executive Board composed 
of the 'six county cdmniss loners from these two counties. The population of 
the consortium is just under 180,000, and most of the population Is spread out 
among several small towns in the two county area. The major population canter 
in the consortium is the city of Bangor, which has a population of 33,000. The 
population is predominately white (99%) , and 15X of the people in the area are 
living below the poverty level. The consortium's unemployment rate has generally 
remained close to the national average, but shows seasonal fluctuation reaching 
■ l e v ejj significantly above the national average during the winter months. Paper 
manufacturing is the major industry in the area, but most of the private sector 
employment opportunities for CETA clients are in relatively small manufacturing 
enterprises. 

\ . . 

CETA programs in Penobscot County are administered by the Penobscot "~ 
Consortium Training and Employment Administration (PCTEA) . The prime sponsorship 
was established in FY 1976 after a year of CETA experience under the administration 
of the state. During the first year of PCTEA control a comprehensive delivery 
system was developed, which Involved the tertalnatlon of subcontracts with most 
of the existing program operators, and the redirection of the thrust of 
employment and training programs away from work experience and toward classroom 
training and OJT. This was accomplished throu^ the efforts of an imaginative 
and ene«getlc staff with the solid support of the county commissioners. 

The comprehensive delivery system that was established in the Penobscot 
Consortium centers around three Offices of Training and Employment Programs (OTEPs), 
which were located In a manner that Insured ser^ce to the entire consortium. 
These offices can make available to CETA cllenti ^he complete range of 
employment and training services because programs- from all the principal CETA 
titles are Integrated in a unified service delivery effort. The OTEP offices 
are coordinated by the PCTEA central staff, which is also responsible for 
planning, monitoring, and evaluating all CETA programs in the cotisortlum. 
All the programs are run in^house with the exception of OJT development in unionised 
occupations, which is subcontracted to the AFL-CIO. The In-house system 
facilitates frequent and constructive communication exchanges among all 
staff units. 

• Initially, planning focused on overhauling the existing system. Once the 
comprehensive delivery system under PCTEA control was in place, planning became 
increasingly oriented toward operational matters. A great deal of effort has 
been directed at refining and expanding on a basic" design that is considered . 
to be sound. This refining effort is aided bv extensive formal and informal 
monltorlftg and supported by a high quality MIS. With the development of an 
impressive evaluation capacity, planning now Includes a strategic component. 
Evaluation studies are being undertaken that will test basic assumptions about 
the effectiveness of different employment and training strategies. 

The PCTEA is coranitted to serving the disadvantaged in CETA programs, and 
their record of participant service indicates that this goal has been achieved. 
They also believe tha^disadvantaged cUents often require more than one pro- 
grammatic service on their road to job readiness, and* the delivery system • 
has been designed to meet this need. This approach has led to relatively high 
costs per placement, and lower placement rates (calculated on the basis of total 
enrollment) than might be expected. Nevertheless, the PCTEA has generally achieved 

' placement rates that are higher than the national average, which in combi^nation 
with their low rates of non-positive termination suggests that the program is 

. achieving its basic goals . Id*) 
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Ibe San Francl«co prlae sponsorship encompasses the city and co(nty of 
San Franclsco» a consolidated, general purpose political unit. Geographically 
soall, the city is a densely populated urban area vlth an unemployment rate 
that lA consistently higher than the national average. 

* 

One of five counties In the San Frandsco-Oakland Bay Area SMSC, San 
Francisco has a white collor job base with relatively few industrial and ' 
manufacturing Jc{>s, teflecting the predominance of comaerce. Insurance, 
^ finance, and government business In the city. Host Job openings and 
J replacement needs for which CEXA participants can co^ete are in the 
secretarial and clerical areas. |; 

Ihe polyglot populatflon in San Francisco consists of a large number of 
identifiable ethnic, racial, and cultural groiq>s. The population's diversity 
Is reflected in the choice of significant segi^ts to be served in CETA 
programs. This diversity also helps to account for the large number of 
subcontractors funded to deliver manpower services — there were more than 30 
in Fy 78 for Title X alone. * * 

Std>con tractors are chosen every year through a formal RFP. Selection 
decisions and funding level decisions are made by the t^power Planning Council 
(MFC), In close interaction with the' planning staff. All service deUvereT 
contracts are performance-based and contain quantitative and qualitative 
goals. Refunding of service deliverers depends largely on past performance. 
Service deliverers are closely monitored by the operations staff. 

The manpower delivery system In San Francisco allocates nearly 75Z of 
the Title I eaepen'dltures to occupational training, vof^tional ESL, and OJT 
in order to make GETA participants employable and competitive In the lAor 
market. 

The public planning process entails a close- working relationship between 
the planning staff and mendiers of the MFC. The MFC is an active and aggressive 
council and has a very important role in planning decisions. The MPC 
determines how mon^ will be allocated, who will be served, and which 
subcontractors will be funded. It also evaluates program performance each 
year. The information from the prime sponsor's MIS unit is an essential 
co&ponent of all of the planning decisions made by the MPC and the planning ^ 
staff. ' 

Frogram performance in San Francisco is good both in quantitative and 
qualitative terms. The prime sponsorship's performance has typically been 
better than national averages on placement rate, non-positive termination 
rate, and cost per placement. The continuous attention of tlie staff emd 
the MFC to monitoring and evaluating the performance of the system as a 
whole and of all of its individual subcontractors helps to account for the 
good performance, which has been improving over time. 
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SYBACDSE, NEW IXBR 

Syracuse^a singla-^ity prime aptHisorahlp with a declining population eatl- 
laated at 177,.OuO in 1978 (doim from 197,000 in 1970), had an unemployment rate of 
b^tv^n 102 and IIZ in the first half of 1976. The rate now hovers slightly 
above 71. Tiie city*8 labor force ig declining in si^e frcfm a 1975 peak of 
96,000. The majority of its members are white (86Z), male (61Z), and between 
22 4nd 44 (51Z) • Blacka represent about lOZ of the city^s population and about 
15Z of the unemployed. Manufacturing jqba are disappearing. Blue collar jobs 
are projected to comprise only 19X of the openings occurring between '^1974-85, while 
whitB collar jobs doisdiiate with. 65Z, and service occiq>ations provide 16%. 

Ihe CETA programs are all operated by the city's Office of Federal and 
State Aid Coordination (OFSAC) which has contracted intake, classroom training, 
and basic ^iducatlon to community based organizations and ES, the Skill Center, 
and the state university system respectively; and staffed assessment, counseling, 
adult and youth work experiaice, OJT» individual referral, job development, and 
\ placement with city staff. Th^re is al&o a planning staff of about 5 people 
(for. Title 1) and fiscal and evaluation units* They are generally competent, 
dedicated » young, and often cited as the primary reason for the programme success. 
Few oi th^ came from categorical programs. 

'The program is fundedfat about $1.6 million annually for Title I. It 
typically allocates sliglitly ibore than 40% of this to classroom training, but 
this 40% is being shifted to yise in individual referral, with the Skill Center 
due to make the conversion cotiplete in FY 1979.^ The remaining 60% is divided 
among OJT, work experience, aid client servijces. OJT has been deliberately 
increased and'ls due to becon^ 25% of the whole in FY 1979, at the expense of 
work experience.* 

Planning, which is central to the program, is dominated by an activist 
staff and defined in broadest terms as the construction of goals, the review 
of present capabilities, and the determination of appropriate courses of action. 
Long term goals are defined, translated into short term goals » and implemented. f 
Monitoring, which is thoroug|i and systematic^ provides important data input. 
Socio-economic data is also used, but with caution. The advisory council is 
passive, has no important role in the selection of service deliverers, and is 
most influential in its committees, which review and check target groiips, target 
occupations, service deliverer evaluations, and — to a lesser degree — ^program 
mix to catch errors or suggest improvements *in staff recomnendation£^\^ These, 
however, because of demonstrated staff competence, are usually trusted. 

* * * 

OFSAC views CETA as one element In a centralized grants management system 
that should Integrate help from different funding sources In addressing Ipcal 
needs. Staff who plan CETA are also active In planning Revenue Sharing, Public ^ 
Works, and other federal programs. Goals for Title I Include getting good narks 
on standard efficiency mieasures (where the non-posltlve termination rate Is . 
especially favorable) , providing coiq>rehenslve and adequate Individualized 
services without creaming, and contributing to Increased piibllc sector 
Involvement and economic development activities. Progress Is being made toward 
all of these. 
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Sytacu&e staff neofeers have been active in the Qaployment and Training 
Council of the Conference of Hayors, (The Hayor of Syracuse was President of 
the Conference.) Their activity put them in contact with progressive prliae 
sponsors. Increased their confidence, and kept them avare of Issues. Decisions 
on the shape of Title I are made with awareness of the optioqs and because they 
contribute to keeping Syracuse a "good nevs" program, but not jxist foxf 
'^expediecy. The program appears to be a vital and growing ^ne that is using 
maturing manpower skills to depart decisively from categorical inheritances. 
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Where to Get More Information 

For more information on this and other programs of research and development funded by the Employment 
and Training Administration, contact the Employment and Training Administration, U.S. Department of 
Labor. Washington. D.C. 202 1 3. or any of the Regional Administrators for Employment and Training whose 
addresses are listed below. 



Location 



States Served 



John F. Kennedy BIdg. 
Boston, Mass. 02203 



Connecticdi 
Maine 

Massachusetts 



New Hampshire 
Rhode Island 
Vermont 



1515 Broadway 
New York, N.Y. 10036 



^ew Jersey 
New York 
Canal Zone 



Puerto Rico 
Virgin Islands 



P.O. Box 8796 
Philadelphia, Pa. 19101 



1371 Peachtree Street. NE. 
Atlanta. Ga. 30309 



Delaware 
Maryland 
Pennsylvania 

Alabama/ 
Florida 
Georgia 
Kentucky 



Virginia 
West Virginia 
District of Columbia 

Mississippi 
North Carolina / 
South Carolina 
Tennessee 



230 South Dearborn Street 
Chicago. IIL 60604 

911 Walnut Stree^ 
Kansas City. Mo. 64106 



Illinois 

Indiana 

Michigan 

Iowa ■ 
Kansas 



Minnesota 
Ohio 

Wisconsin 

Missouri 
Nebraska 



Griffin Square Bldr; 
Dallas. Tex. 75202 



Arkansas 
Louisiana 
New Mexico 



Oklahoma 
Texas 



1961 Stout Street 
Denver. Colo. 80294 



Colorado 
Montana 
North Dakota 



South Dakota 
Utah 

Wyoming 



450 Golden Gate Avenue 
San Francisco. Calif. 94102 



Arizona 
California 
Hawaii 
Nevada 



y^merican Samoa 
Guam 

Trust Jerritory 



909 First /?'venue 
Seattle, Wash 98174 



Alaska 
Idaho 



Oregon 
Washington 



